-- Logs begin at Mon 2022-09-19 10:40:17 UTC, end at Mon 2022-09-19 11:50:30 UTC. -- Sep 19 11:10:45.697226 dv-cinder-820994-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 11:10:45.706373 dv-cinder-820994-5-smb devstack@keystone.service[81373]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:10:45 2022] *** Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: nodename: dv-cinder-820994-5-smb Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: machine: x86_64 Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: clock source: unix Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: pcre jit disabled Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: detected number of CPU cores: 4 Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: current working directory: / Sep 19 11:10:45.708393 dv-cinder-820994-5-smb devstack@keystone.service[81373]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: your processes number limit is 47680 Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: your memory page size is 4096 bytes Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: detected max file descriptor number: 2048 Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: lock engine: pthread robust mutexes Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: thunder lock: enabled Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 11:10:45.709055 dv-cinder-820994-5-smb devstack@keystone.service[81373]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:10:45.749603 dv-cinder-820994-5-smb devstack@keystone.service[81373]: Python main interpreter initialized at 0x55e78102a9c0 Sep 19 11:10:45.749603 dv-cinder-820994-5-smb devstack@keystone.service[81373]: python threads support enabled Sep 19 11:10:45.749603 dv-cinder-820994-5-smb devstack@keystone.service[81373]: your server socket listen backlog is limited to 100 connections Sep 19 11:10:45.749603 dv-cinder-820994-5-smb devstack@keystone.service[81373]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:10:45.749960 dv-cinder-820994-5-smb devstack@keystone.service[81373]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:10:45.750040 dv-cinder-820994-5-smb devstack@keystone.service[81373]: *** Operational MODE: preforking *** Sep 19 11:10:45.750280 dv-cinder-820994-5-smb devstack@keystone.service[81373]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:10:45.750280 dv-cinder-820994-5-smb devstack@keystone.service[81373]: spawned uWSGI master process (pid: 81373) Sep 19 11:10:45.750484 dv-cinder-820994-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 11:10:45.751459 dv-cinder-820994-5-smb devstack@keystone.service[81373]: spawned uWSGI worker 1 (pid: 81385, cores: 1) Sep 19 11:10:45.751459 dv-cinder-820994-5-smb devstack@keystone.service[81373]: spawned uWSGI worker 2 (pid: 81386, cores: 1) Sep 19 11:10:45.752964 dv-cinder-820994-5-smb devstack@keystone.service[81373]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:10:50.083596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:10:50.083596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 19 11:10:50.084403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:10:50.084403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 19 11:10:50.084858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:10:50.084858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 19 11:10:50.084969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:10:50.084969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: from cryptography.utils import int_from_bytes Sep 19 11:10:50.135312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:10:50.135502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:10:50.135654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:10:50.135753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] command line args: [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:10:50.135854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:10:50.135958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:10:50.136048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] command line args: [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:10:50.136120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ================================================================================ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:10:50.136306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:10:50.136385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.136486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ================================================================================ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:10:50.136628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_dir = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.136769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.136848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.136989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] config_source = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_dir = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] debug = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_source = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] debug = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.137915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_config_append = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.138955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_dir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_config_append = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_dir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.139998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.140875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.141954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.142919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] publish_errors = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] publish_errors = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.143990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] standard_threads = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.144937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] standard_threads = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_journal = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_json = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.145920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_stderr = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_journal = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] use_syslog = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_json = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_stderr = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.146541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_syslog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:10:50.146776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.146953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.147999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.148918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.149966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.150915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.151926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.152680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.153908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154768 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.154851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.155948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.156985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.157896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.158978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.159921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.160986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.161987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.162972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.163951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.164925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.165958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.166908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.167844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.168012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.168094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.168254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.168339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.169906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.170976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.171959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.172883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.external = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.external = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.173896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.password = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] auth.token = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.password = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.token = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.174935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.175964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.176941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.177911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.178874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.179905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180135 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.180881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.181990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.182959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.183981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.184870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.185973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186768 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.186941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.187922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.188970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.189882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.190919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.191920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.192974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.193966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.194984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.195943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.196938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.197943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.198885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.199066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.199709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.199893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.200940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.201948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.202954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.203966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.204904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.205942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.206996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.207974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.208947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.209076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.209710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.209893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.210922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.211920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.212962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.213970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.214985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.215944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.216971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.217981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.218991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.219972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.220956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.221909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.222615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.223960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.224038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.224195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.224281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.224355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:10:50.224426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:10:50.224626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:10:50.255936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.256147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.256380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.260137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.260368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.260612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.265362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.269526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.294194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.294421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.296657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.296890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.348207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.348498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.396680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.396911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.397630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.397871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.552988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.553548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.576688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.576908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.576996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.577875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.578003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.578084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.578220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.588977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.589347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.602757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.602867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.602947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.603903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.604034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.604126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81386) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 11:10:50.620971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.621122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.621208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:10:50.621331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:10:50.621536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.621713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.621851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:10:50.622023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 11:10:50.622292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.622920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.623076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.632473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.632722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.632809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.633001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.633084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.633270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.633354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.633553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.640818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.641138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.643724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.644007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.644090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.644958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.645946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.646749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.669842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.669970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.671306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.671394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.671596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.671697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.676265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.676352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.676550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.676645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.676857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.676941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.683145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.683230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.683435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.683517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.689872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.689987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.690168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.690252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.690457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.690557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.690746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.690829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.691923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.707876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.707970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.708155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.708237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.712019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.712118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.715242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.715331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.715629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.715719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.719844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.720030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.723242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.723514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.726440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.726748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.726833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.727960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.728168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.743626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.743899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.743983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.744179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.744260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.744445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.744527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.744729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.752012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.752361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.753559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.753931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.755066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.755348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.755468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.755749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.758081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.758370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.758453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.758658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.758786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.758952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.759041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.759251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.759341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.759648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.770780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.770912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.771069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.771196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.771359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.771479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.771645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.771759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.772737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.788570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.788703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.791500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.791592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.794492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.794589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.795937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.796021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.797425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.797511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.797707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.797789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.798099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.798184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.804406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.804500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.805894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.805996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.808789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.808874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.809711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.809988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.810149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.810238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.810303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.810376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.818028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.818222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.818322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.818523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.818606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.818813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.825496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81386) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.825772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.825858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 11:10:50.826050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.826957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.827971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.828907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.829078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81386) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.829187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.829459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 11:10:50.863856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e78102a9c0 pid: 81386 (default app) Sep 19 11:10:50.864117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e78102a9c0 pid: 81385 (default app) Sep 19 11:10:50.867064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035864-798b-4d27-ad19-c4cd1ab7c62c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:50.867347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035864-798b-4d27-ad19-c4cd1ab7c62c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:50.867614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6035864-798b-4d27-ad19-c4cd1ab7c62c None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:50.872290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Mon Sep 19 11:10:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:10:57.713422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.713933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.713933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.718296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:10:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:10:57.723800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.724227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.724364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.795504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: INFO dbcounter [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] Registered counter for database keystone Sep 19 11:10:57.815088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG oslo_db.sqlalchemy.engines [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:10:57.821212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writer thread running {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:10:58.000799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81386) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:10:58.001103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG passlib.handlers.bcrypt [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81386) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:10:58.058697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:58.060339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.188069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:10:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 11:10:58.653747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:58.726922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: INFO dbcounter [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] Registered counter for database keystone Sep 19 11:10:58.749425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:10:58.755628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writer thread running {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:10:58.878962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ddd09-c279-4739-b7bc-66515e99807d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:58.883246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:58.883858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.884136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.884404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.893915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:58.946374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:10:58.946662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c01e-59c5-41ea-a137-46a192cff2dd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:58.956482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Mon Sep 19 11:10:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:10:58.962541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:58.980067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd4ec4-6d10-448c-9fbb-8e135d4bf591 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:58.985093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:58.986201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.986476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.986742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] PATH_INFO: `/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.988327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd2e4c4b06fe4e64af36c6417cd1e022)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:59.044392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 11:10:59.044839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c9be2-c73c-4100-8a23-6675c4cc0b87 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:59.051222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Mon Sep 19 11:10:58 2022] GET /identity/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:01.260778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3362fc-3c75-4a3c-a94a-4b6d117f2f29 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:01.261299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3362fc-3c75-4a3c-a94a-4b6d117f2f29 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:01.261299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3362fc-3c75-4a3c-a94a-4b6d117f2f29 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:01.265978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:11:01.271396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:01.271803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:01.271942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:01.292200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:01.294398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:01.302319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 11:11:01.569268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3362fc-3c75-4a3c-a94a-4b6d117f2f29 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:01.581933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3362fc-3c75-4a3c-a94a-4b6d117f2f29 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:01.586103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:01.586685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:01.586959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:01.587226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:01.595340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:01.597119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f68fd-7eda-41c2-b05e-d96a89247ce9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:01.605962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Mon Sep 19 11:11:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:11:01.611496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:01.620692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88cd56-8572-4052-8d5d-a580a26e51d4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:01.625355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:01.625976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:01.626260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:01.626537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:01.627853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:01.629709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fae98-45bf-4935-a926-ba6ba0fb365f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:01.631236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Mon Sep 19 11:11:01 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:03.853190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf602-4d7a-4241-b41d-8af2a762b8ee None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:03.853735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf602-4d7a-4241-b41d-8af2a762b8ee None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:03.853735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf602-4d7a-4241-b41d-8af2a762b8ee None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:03.855071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:11:03.860481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:03.860958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:03.861151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:03.866925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9e00-0584-4822-82ea-ffc91196abce None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:03.867211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9e00-0584-4822-82ea-ffc91196abce None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:03.867483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b9e00-0584-4822-82ea-ffc91196abce None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:03.868802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:11:03.873975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:03.874266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:03.874548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:03.879996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:03.881310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:03.916294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 11:11:03.916711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 11:11:03.966223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:03.967833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:03.970805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:04.067565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:04.245816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.271334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.333272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.353062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf0dac-a3a9-4bdf-9127-a822dbd68e4f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.388493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.389153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.389429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.389701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.400828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:04.409839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:04.410898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:04.411741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:04.412995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:04.416848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.443010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9fc69-8d4e-42d9-8a7c-6d173bb161f1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.445292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.483976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.484791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.485068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.485335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.499916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.518969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47108c6-08c7-4bf2-a97b-08866da6c392 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.553782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.555314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.564490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.565181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.565837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.566131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.566828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:04.567488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.569091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.583309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:04.589129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.662105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:11:04.667869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.671104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.697908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc5721-c40c-4324-8a6e-61787bb2f5e0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.732521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.733166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.733442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.733708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.734907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.736309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.737876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:04.743309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.758210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.766440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becad72f-413c-45ef-b23b-94f2cdd9dcf7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.800312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.801194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.801502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.801774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.820471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.821951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:11:04.840865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:04.841869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:11:04.842667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:11:04.842667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:11:04.842667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:04.842667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:04.843957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357136a7-dcf0-4b26-a9ee-723e5c440918 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.848260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.881532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.882150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.882425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.882694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.883860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.885337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.886878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:04.892475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:04.906249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.953200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36404f3-2e87-403d-9a02-e78398deb8e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:04.976124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:04.986943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:04.987486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:04.987765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:04.988036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:04.988711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:04.989013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:04.990394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84779fb1-bcf7-49d5-8d64-a454ff09d2a9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:04.995349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c219621-f98d-41bf-a2a7-5850cbc35178 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:05.008332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 10/20] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:05.031496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:05.032121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:05.032397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:05.032696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:05.033438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.domain.id=default, user.id=3ab5d70b339a4058a47f19e5d4098fad) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:05.033743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:05.035220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68a32-68e5-47ee-a9f6-25a7861be6a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:05.042789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 11/21] 10.222.0.71 () {56 vars in 1322 bytes} [Mon Sep 19 11:11:04 2022] GET /identity/v3/role_assignments?user.id=3ab5d70b339a4058a47f19e5d4098fad&scope.domain.id=default&role.id=831a0d01705f489683bef40d08847bc6 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:07.586660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a969-e68f-442b-8bdc-eb0c8b0b048c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.587169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a969-e68f-442b-8bdc-eb0c8b0b048c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.587242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a969-e68f-442b-8bdc-eb0c8b0b048c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:07.588877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 11/22] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:07.594973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b997-1e1f-4821-a5a6-da0f8495c299 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.595461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b997-1e1f-4821-a5a6-da0f8495c299 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.595540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b997-1e1f-4821-a5a6-da0f8495c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:07.621695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6c46b997-1e1f-4821-a5a6-da0f8495c299 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:07.622925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6c46b997-1e1f-4821-a5a6-da0f8495c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:07.713338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 12/23] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:07.949282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f56ff-073f-4438-9056-a05511196394 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.949650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f56ff-073f-4438-9056-a05511196394 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.949937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f56ff-073f-4438-9056-a05511196394 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:07.951573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:07.956613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2d31-e999-4c77-a1a9-0cc753e41ddf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.956911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2d31-e999-4c77-a1a9-0cc753e41ddf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.957187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2d31-e999-4c77-a1a9-0cc753e41ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:07.959072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16dd-bf98-4af0-ab2c-4075af434e54 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.959351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16dd-bf98-4af0-ab2c-4075af434e54 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.959620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16dd-bf98-4af0-ab2c-4075af434e54 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:07.961084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 13/25] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:11:07.976544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9400-fbab-4e55-a8e2-e36687b2a164 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:07.976865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9400-fbab-4e55-a8e2-e36687b2a164 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:07.977112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9400-fbab-4e55-a8e2-e36687b2a164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.007381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-567d2d31-e999-4c77-a1a9-0cc753e41ddf None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:08.008607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-567d2d31-e999-4c77-a1a9-0cc753e41ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:08.011474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a4be9400-fbab-4e55-a8e2-e36687b2a164 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:08.013035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a4be9400-fbab-4e55-a8e2-e36687b2a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:08.129631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 14/26] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:08.132407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f3df5-0b67-4cc2-b192-935571a435a4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.133258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f3df5-0b67-4cc2-b192-935571a435a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.133964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f3df5-0b67-4cc2-b192-935571a435a4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.136147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 15/27] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:08.137222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f3df5-0b67-4cc2-b192-935571a435a4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:08.157097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 13/28] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:08.158827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.160653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.161786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.176637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:08.195243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:08.197589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:08.250215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:08.337919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 14/29] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:08.351018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f3df5-0b67-4cc2-b192-935571a435a4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:08.386829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:08.388777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.389285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.389747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.407357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:08.409180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:11:08.427417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:08.428284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:11:08.429111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:11:08.429111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:11:08.429111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:08.430951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 16/30] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:08.436979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:08.461866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:08.639969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:08.644860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a27e3-878b-455b-83b7-26978fc058b0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:08.660610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118aaf-939e-4ab1-b91f-30e36415ddf5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:08.710297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:08.710930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.711214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.711490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.725382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:08.726335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.726839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.727307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.728161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:08.728708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:08.730356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:08.732516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:08.736609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:08.743252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:08.744090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:08.744859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 17/31] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:08.752844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:08.758692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 15/32] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:08.763540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:08.900055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee61bb-a110-4646-83b6-8f6a13693c4a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:08.900766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b760d6-023b-4cef-bf31-87d728c12cd1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:08.940037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:08.940710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.940961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.941237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.942084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:08.944110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:08.947821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:08.948618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:08.949040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:08.949545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:08.951018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:08.951514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:08.953818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:08.971051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 16/33] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:08.971051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:09.036000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:09.087058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89876a-5c37-4962-aa26-718226c72a1f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:09.117208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 18/34] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Sep 19 11:11:08 2022] POST /identity/v3/roles => generated 219 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:09.117208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:09.143741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:09.171258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:09.171798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.172080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.172355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.173066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:09.174800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:09.298542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb24a-d0cb-4c4c-bf98-db92f75cf062 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:09.359348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:09.360913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.361252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.361569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.362275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:09.363814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe71c85-9b57-4e0b-b027-26a663e93090 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:09.384687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 17/35] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:11:08 2022] POST /identity/v3/projects => generated 301 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:09.386588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:09.397809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 19/36] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Sep 19 11:11:09 2022] POST /identity/v3/roles => generated 225 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:09.409456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e256-de75-42e9-9c37-ba0903e127b9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.409882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e256-de75-42e9-9c37-ba0903e127b9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.410258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e256-de75-42e9-9c37-ba0903e127b9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.411770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 20/37] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:09.418584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbeb7-2906-4f03-bfe0-f6fab774d5c8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.419009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbeb7-2906-4f03-bfe0-f6fab774d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.419589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbeb7-2906-4f03-bfe0-f6fab774d5c8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.421482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 21/38] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:09.422761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.423146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.423516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.485287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:09.487057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:09.539970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b29a7-86b4-44fe-818d-d43ee690dc4a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:09.554232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:09.598817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:09.598817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.599076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.599281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.601252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:09.603115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119a681-33e3-46d4-b024-79f2205046f1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:09.606964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 18/39] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:09 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:09.607874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.608107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.613000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.634156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 22/40] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:09.635359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:09.636065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:09.637791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:09.652155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:09.750675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 19/41] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:09.796776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cbecc-0262-4954-89cb-74d87d3c9a98 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:09.837712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:09.838446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:09.838798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:09.839143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:09.841848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:09.843703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:09.845752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 23/42] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:09.853644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:09.930647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:10.021219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:10.046548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34f805-c46b-4a78-90d7-55ad822e7b53 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:10.065124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bee34a-6bf3-44ac-a6c7-84cc790dfd7b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:10.071895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:10.080335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:10.080976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:10.081259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:10.081533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:10.082216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:10.083580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:10.098363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 24/43] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Sep 19 11:11:09 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:11:10.099163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:10.102447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:10.103129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:10.103406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:10.103721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] PATH_INFO: `/v3/domains/default/users/3ab5d70b339a4058a47f19e5d4098fad/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:10.105839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3ab5d70b339a4058a47f19e5d4098fad, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:10.107327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:10.125317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 20/44] 10.222.0.71 () {58 vars in 1361 bytes} [Mon Sep 19 11:11:09 2022] PUT /identity/v3/domains/default/users/3ab5d70b339a4058a47f19e5d4098fad/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:10.227127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139dd7a-c134-43fd-85e3-b15df567d28c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:10.269538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:10.270192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:10.270542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:10.270820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:10.272082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:10.273621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998128bd-a2be-4965-bee9-c349590ca08f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:10.275573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 25/45] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:10.281614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:10.394689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41691d-68ed-40cb-b82d-fa0a528c03de None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:10.431787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:10.432399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:10.432701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:10.432971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:10.433614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:10.435681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60584d82-bd4f-472d-abed-3ff2458d780e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:10.462049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 21/46] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:11:10 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:12.327523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b64106-12ab-432f-ab3a-6a0c84ec99dc None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.328061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b64106-12ab-432f-ab3a-6a0c84ec99dc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.328061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b64106-12ab-432f-ab3a-6a0c84ec99dc None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.329447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 26/47] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:12.334835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02b18-bfa6-4e7f-819f-dd9f569037c8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.335213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02b18-bfa6-4e7f-819f-dd9f569037c8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.335505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02b18-bfa6-4e7f-819f-dd9f569037c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.354015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dfe02b18-bfa6-4e7f-819f-dd9f569037c8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:12.355186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dfe02b18-bfa6-4e7f-819f-dd9f569037c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:12.369030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:12.424174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 22/48] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:12.598705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9d1-3e5c-4f59-bdde-36f735749e9d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.598995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9d1-3e5c-4f59-bdde-36f735749e9d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.599274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9d1-3e5c-4f59-bdde-36f735749e9d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.600643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 27/49] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:12.606341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.606636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.606915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.625332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:12.626524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:12.691610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f9d1-3e5c-4f59-bdde-36f735749e9d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:12.692055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 23/50] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:12.695336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:12.791506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f9d1-3e5c-4f59-bdde-36f735749e9d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:12.825757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:12.826370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.826649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.826920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.836831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:12.843013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:12.843830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:12.844566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 28/51] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:12.850931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:12.927143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:12.949306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cdc34-9a38-4a81-ba22-ddf330c5b8f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:12.963741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:12.983906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:12.984523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:12.984833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:12.985107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:12.985771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:12.986079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:12.987467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:12.995451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 24/52] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:13.001268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:13.024544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:13.067146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff144-d5ca-461e-a18f-aa42d3afbd9d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:13.102057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:13.102591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:13.102871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:13.103140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:13.104234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:13.104548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b99556-af57-4c74-9ad2-91f8360d18bc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:13.105730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:13.107290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 29/53] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:13.112742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:13.138647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:13.139279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:13.139553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:13.139825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:13.140995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:13.142434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:13.144058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 25/54] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:13 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:13.149367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:13.160665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:13.215867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fedfc-a4c4-4c1b-af88-79c8ebd49141 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:13.244502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:13.250486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb42a2-4a87-4660-a8ea-38677979b509 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:13.250788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:13.251397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:13.251678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:13.251951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:13.252618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:13.254058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:13.284599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 30/55] 10.222.0.71 () {60 vars in 1140 bytes} [Mon Sep 19 11:11:13 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:11:13.286043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:13.286761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:13.287045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:13.287321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:13.288475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:13.289990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2d372-57a8-4e8c-a097-b4d6257af073 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:13.291634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 26/56] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:13.298026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:13.405051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcd796-023c-4fc1-aead-4c7960fe4537 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:13.543792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:13.544597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:13.544879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:13.545149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:13.545871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.domain.id=default, user.id=3ab5d70b339a4058a47f19e5d4098fad) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:13.546173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:13.547593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c2be-e802-4bd3-b887-124fb929d664 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:13.556062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 31/57] 10.222.0.71 () {56 vars in 1322 bytes} [Mon Sep 19 11:11:13 2022] GET /identity/v3/role_assignments?user.id=3ab5d70b339a4058a47f19e5d4098fad&scope.domain.id=default&role.id=831a0d01705f489683bef40d08847bc6 => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:15.473885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9ec9-4e6b-46d2-8ea6-3e684dc1f36a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:15.474373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9ec9-4e6b-46d2-8ea6-3e684dc1f36a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:15.474373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9ec9-4e6b-46d2-8ea6-3e684dc1f36a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:15.475694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 27/58] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:15.481236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:15.481644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:15.481791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:15.499907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:15.501113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:15.542686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:15.565678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 32/59] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:15.837109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9ec9-4e6b-46d2-8ea6-3e684dc1f36a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:15.912997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:15.937682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9ec9-4e6b-46d2-8ea6-3e684dc1f36a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:15.969655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:15.970269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:15.970548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:15.970816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:15.971900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:15.973894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868545a-fcb2-430c-bf49-58d0b4fd7ea0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:15.975487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 28/60] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:15.981841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:16.080225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834caa21-fd51-4140-b62d-b66577ae3bd5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:16.112995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:16.113536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:16.113817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:16.114089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:16.114744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:16.116171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aad222-87a4-4fe1-858a-fd7fb77731c0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:16.142766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 33/61] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:15 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:19.508287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68750-12ad-4cef-b440-26088915d83d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.510913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68750-12ad-4cef-b440-26088915d83d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.510913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68750-12ad-4cef-b440-26088915d83d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.510913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 29/62] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:19.516768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbf052-1552-4b1a-bf61-9a7250483918 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.517580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbf052-1552-4b1a-bf61-9a7250483918 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.518053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbf052-1552-4b1a-bf61-9a7250483918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.544036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6acbf052-1552-4b1a-bf61-9a7250483918 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:19.545459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6acbf052-1552-4b1a-bf61-9a7250483918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:19.584956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:19.640337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 34/63] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:19.646981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c745-2770-43c8-851d-b66d16a71806 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.647535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c745-2770-43c8-851d-b66d16a71806 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.648009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c745-2770-43c8-851d-b66d16a71806 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.649614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 30/64] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:19.655679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eaa8a-1303-48ee-9303-d33d1cd43449 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.655971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eaa8a-1303-48ee-9303-d33d1cd43449 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.656246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eaa8a-1303-48ee-9303-d33d1cd43449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.696877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-316eaa8a-1303-48ee-9303-d33d1cd43449 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:19.698090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-316eaa8a-1303-48ee-9303-d33d1cd43449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:19.798957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 35/65] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:19.835561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbd2d-35d5-403e-a508-9af41de69972 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.835876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbd2d-35d5-403e-a508-9af41de69972 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.836115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bbd2d-35d5-403e-a508-9af41de69972 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.837727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 31/66] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:19.843804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9fc0-1a4d-43f7-a476-0cbc66bf874f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.844094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9fc0-1a4d-43f7-a476-0cbc66bf874f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.844373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9fc0-1a4d-43f7-a476-0cbc66bf874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.869806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1dae9fc0-1a4d-43f7-a476-0cbc66bf874f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:19.871091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1dae9fc0-1a4d-43f7-a476-0cbc66bf874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:19.958870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 36/67] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:19.988944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b4ec1-17ce-47b0-aec1-f1ca4f8e9e7d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:19.989573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b4ec1-17ce-47b0-aec1-f1ca4f8e9e7d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:19.990071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b4ec1-17ce-47b0-aec1-f1ca4f8e9e7d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:19.991694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 32/68] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:20.001249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.001541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.001822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.029579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:20.030796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:20.056206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.085640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b4ec1-17ce-47b0-aec1-f1ca4f8e9e7d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.120254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 37/69] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:20.120991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.249567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e5853-fcba-4b07-8ecb-2270b55b9d26 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.287513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.288409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.289006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.289446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.298327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b4ec1-17ce-47b0-aec1-f1ca4f8e9e7d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.303145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:20.309129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:20.309980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:20.310751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 38/70] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:20.311370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.329578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.343850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.344478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.344795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.345071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.356125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3dd232c0-55b0-4be7-b397-3df1edddad8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:20.361110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:20.361951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:20.363107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 33/71] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:20.363942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e808b-4c6a-4a4e-ac99-189a990491c9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.363942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e808b-4c6a-4a4e-ac99-189a990491c9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.364067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e808b-4c6a-4a4e-ac99-189a990491c9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.365429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 34/72] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:20.369761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e808b-4c6a-4a4e-ac99-189a990491c9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.373637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.420191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577c0b8-fdfa-449c-a8e5-5a91df9ade0d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.454680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.455308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.455589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.455860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.466202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:20.471015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:20.471919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:20.472719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 39/73] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:20.473602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.484756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e808b-4c6a-4a4e-ac99-189a990491c9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.519075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.519671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.519948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.520220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.520923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:20.521227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:20.522618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af695f-843e-491c-8396-19fa756d4066 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:20.531129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 35/74] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:20.532279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.532565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.532868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.551469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:20.552709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:20.553056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.579461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d9ce-ecdf-4dba-ad94-b5e8019ca180 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.613189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.614053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.614685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.614919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.615217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.615856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:20.616155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:20.617569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:20.621752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 36/75] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:20.622573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.629899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 40/76] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:20.629899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.725601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e651-4750-4f51-bc4a-116726b7b19e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.738683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47033-26e4-40af-9365-b50cb11eff41 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.760348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.761157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.761444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.761843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.772887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:20.773231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.773830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.774107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.774382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.775037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:20.775336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:20.776739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:20.778532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:20.779546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 37/77] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:20.781355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.785521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.793250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 41/78] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:20.794245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.847362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:20.896198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe1c-b034-47ff-9102-dd6baf9a601d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.909419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ce4af-72fe-463b-bdea-bc8c2f22f3d1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:20.929213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.929836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.930114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.930385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.931490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:20.932962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:20.935037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 38/79] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:20.938275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:20.947392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:20.948019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:20.948300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:20.948593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:20.964265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:20.965791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:20.967403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 42/80] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:20.968171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.022323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.038512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d23f8f-02b4-4306-8edc-633fff16806e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.061203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.066768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedda8c9-c16e-455c-9fcf-2928fbb27a93 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.073600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.074747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.075031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.075299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.075961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:21.076263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.077658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.085538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 39/81] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:21.086125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.102564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.103125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.103401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.103671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.104839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.106832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.108396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 43/82] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:20 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:21.109181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.189965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ec23d-9a3b-46bd-bbf7-4156716ed509 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.207475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e459fd3-f2ca-4a60-9f41-5dd4bc73ed73 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.224627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.225264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.225541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.225808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.226911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.228367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.230013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 40/83] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:21.231009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.231381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.242237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.242841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.243127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.243393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.287135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.308927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.310399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.332228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76e-f6d0-4113-a1db-7b0c56fcad0c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.365947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.366483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.366764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.367037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.406329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 44/84] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:21.407418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.431516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.437990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.439471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.493398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.506605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac530-b85d-4c43-adbb-c5ef494b436c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.538786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 41/85] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:21.539620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.541067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.541871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.542158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.543337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.544675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.546168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.548164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 45/86] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:21.548935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.637690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.638897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc1a3-0603-44ca-bedb-f9225c8b282d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.647359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51133462-fbf8-4275-8186-6f7f6ec210d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.673000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.673606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.673889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.674166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.680017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.680639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.680927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.681204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.681862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.683288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.698391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.707029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 46/87] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:21 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:21.707029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.751311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.752836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.826365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8f28-7e67-4e69-b3a1-0e001d59538f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:21.867206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:21.867881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:21.868124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:21.868391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:21.869746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:21.872000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:21.873000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 47/88] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:21.873772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.881260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 42/89] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:21.881761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:21.895026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:21.948241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.006310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b3bc-7cf5-42eb-8799-7b7ae677e147 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.017570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879354-0952-4184-8eff-17b99ab2e6e6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.053440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.054082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.054354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.054626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.055819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.057287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.058156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.058772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.059031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 48/90] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.059145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.059345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.059735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.150946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.154099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.157402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.175074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee1bf-2499-4963-bd32-80efcb01e20a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.219936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.220546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.220860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.221141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.221870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=3ab5d70b339a4058a47f19e5d4098fad) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:22.222182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.223891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.229674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 49/91] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/role_assignments?user.id=3ab5d70b339a4058a47f19e5d4098fad&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.230295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.236777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.354877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 43/92] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:22.355807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.363979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a602b4c-a1a8-400e-8b00-dc1d790e9eda None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.432450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.433037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.433311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.434157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] PATH_INFO: `/v3/projects/4a0362cbe96a43349d0641f93d187f4e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.435334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a0362cbe96a43349d0641f93d187f4e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.436823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.438456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 50/93] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/projects/4a0362cbe96a43349d0641f93d187f4e => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.439230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.461594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.552340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e0419-0dc0-4c48-8490-0de1be31b41a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.610793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03396e-137e-4c91-be1a-2c6a2419f3c5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.625767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.627402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.628045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.629790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.630925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:22.632207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.633974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.649553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 44/94] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.650711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.676918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.678313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.679086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.680409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.683986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.686418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.688683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 51/95] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.693987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.696123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:22.868695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:22.882081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49ffe-aa47-463a-97e9-48c3781a1be0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.891054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3322e0c-1f25-412d-b2ff-d0311717132b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:22.948442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.950633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.951585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:22.952100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.953000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:22.953498 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.954467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:22.954973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:22.955497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:22.956023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.957039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=4a0362cbe96a43349d0641f93d187f4e, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:22.959079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:22.961006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1219ca5-fa00-4475-b912-45480149dda0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.963110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c727d5-5558-4d7a-add8-05e2dbc21858 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:22.970953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 52/96] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:22.974295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 45/97] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:22 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=4a0362cbe96a43349d0641f93d187f4e&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:24.600231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02da9d-93c9-4d11-8e5e-153d64ccd301 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:24.600837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02da9d-93c9-4d11-8e5e-153d64ccd301 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:24.600837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02da9d-93c9-4d11-8e5e-153d64ccd301 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:24.602150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 53/98] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:24.612189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5217-e0f5-44c7-b369-3e12e61aaf8e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:24.612476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5217-e0f5-44c7-b369-3e12e61aaf8e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:24.612793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5217-e0f5-44c7-b369-3e12e61aaf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:24.616002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6cb4-1998-4e3d-9f90-981e895608d1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:24.616424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6cb4-1998-4e3d-9f90-981e895608d1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:24.616601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf6cb4-1998-4e3d-9f90-981e895608d1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:24.617916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 46/99] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:24.628057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab021-85c8-45e2-97f5-e1ed1b3d57c3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:24.628356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab021-85c8-45e2-97f5-e1ed1b3d57c3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:24.628619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab021-85c8-45e2-97f5-e1ed1b3d57c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:24.651388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-140b5217-e0f5-44c7-b369-3e12e61aaf8e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:24.652828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-140b5217-e0f5-44c7-b369-3e12e61aaf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:24.660861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-933ab021-85c8-45e2-97f5-e1ed1b3d57c3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:24.662032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-933ab021-85c8-45e2-97f5-e1ed1b3d57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:24.793778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 47/100] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:24.826119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 54/101] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:25.094841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2059-c7f7-4fd4-b26d-39ce49b14ad3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.095206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2059-c7f7-4fd4-b26d-39ce49b14ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.095406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2059-c7f7-4fd4-b26d-39ce49b14ad3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.097058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 48/102] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:25.104437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.104970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.106015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.130534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:25.132023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:25.224179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 55/103] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:25.290627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2059-c7f7-4fd4-b26d-39ce49b14ad3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:25.312606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:25.406460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:25.428948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:25.442855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2059-c7f7-4fd4-b26d-39ce49b14ad3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:25.500615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:25.501907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.502516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.502951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.524091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:25.536601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:25.537440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:25.538206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:25.540769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 49/104] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:25.546796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:25.608614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041150f-2cca-4066-88ed-b567eeaa9f3e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:25.667510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:25.672600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.672600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.672600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.672600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:25.672600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:25.678090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 56/105] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:25.678861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:25.690062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:25.721527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a076bee-8857-4456-af38-9f8d0268531c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:25.774019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:25.775069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.775553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.776024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.776952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:25.777538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:25.779594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:25.800676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 50/106] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:25.802008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:25.831174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:25.884269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc63f5e-abab-4236-85ef-344320878fa8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:25.939866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:25.940557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:25.940963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:25.941333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:25.954766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:25.956357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc81b-5a33-49ac-9636-037539854365 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:25.961293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:25.962141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:25.962902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 57/107] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:25.963525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.001917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.003418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.003849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.004265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.005094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.007632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4c29c-ae03-4bbb-9f0e-90ad3b680f5c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.013490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.048957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 51/108] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:11:25 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:26.052262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a2132-ebaf-47f2-ab54-c25c887d6a4b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.052262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a2132-ebaf-47f2-ab54-c25c887d6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.053396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a2132-ebaf-47f2-ab54-c25c887d6a4b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.054876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 52/109] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:26.057636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a2132-ebaf-47f2-ab54-c25c887d6a4b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.125146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f85c79-cd4a-4b57-962e-9b746672149c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:26.216715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.217382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.217682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.217944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] PATH_INFO: `/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.227548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.251028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] RBAC: Authorizing `identity:get_user(user_id=5d6aaf0030ed4c769ac9ac28f7702f3a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.252538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c091f-14f6-4269-b68c-f06114d9c163 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.254532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 58/110] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:25 2022] GET /identity/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a => generated 289 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:26.255704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.255910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.256146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.267927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a2132-ebaf-47f2-ab54-c25c887d6a4b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:26.275378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:26.277857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:26.311064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.311704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.311992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.313127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.313962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:26.314480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.316731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.330694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 53/111] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:26.331496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.375883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 59/112] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:26.376965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.410689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.469839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0cc9-43a5-4ae8-b72f-19e0c973d0d2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:26.490750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936e033-f0a0-48a9-aa3c-24be516c96c0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:26.506066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.506684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.506967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.507244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.516236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.527808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.528564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.528972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.529250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.530504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.531941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2bef-a593-49eb-b503-a0468c1b3e64 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.533651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 60/113] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:26 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:26.534950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013249-9b38-4645-bae3-8cececd6c6a6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.535249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013249-9b38-4645-bae3-8cececd6c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.535605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013249-9b38-4645-bae3-8cececd6c6a6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.536938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 61/114] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:26.538000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092d66-c0df-458e-9bb7-2be929004b7b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.538409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092d66-c0df-458e-9bb7-2be929004b7b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.538682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092d66-c0df-458e-9bb7-2be929004b7b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.544789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 62/115] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:26.545643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092d66-c0df-458e-9bb7-2be929004b7b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.590788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.592796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc783f-2956-4ef5-b215-e0cf90203be6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.659553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092d66-c0df-458e-9bb7-2be929004b7b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:26.674726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.704229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:26.704894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.705176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.705449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.706572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:26.708010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daef9b-ed74-4b24-8626-e2dde37f7787 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:26.709687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 63/116] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:26 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:26.713828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.714360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.714466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.733048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:26.734173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:26.740113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 54/117] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:26.742072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:26.742428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:26.742790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:26.760958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:26.762837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:26.794533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:26.807619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 64/118] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:26.817019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:26.842973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 55/119] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:26.843926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.003238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77c17-fae5-4208-804f-a7bde92cea4e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.003900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.046111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab00e-74d2-48db-b841-99f2364f7d23 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.069612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.070247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.070591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.070868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.082472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:27.087395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:27.088212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 65/120] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:27.089345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.103427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.104094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.104420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.104844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/users/3ab5d70b339a4058a47f19e5d4098fad/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.107488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, user_id=3ab5d70b339a4058a47f19e5d4098fad, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.109107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.126280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 56/121] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:26 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/users/3ab5d70b339a4058a47f19e5d4098fad/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:27.127442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.178287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.248122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70bd91-d089-4279-adc7-a26ce33c0d6a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.275017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b604-2df5-4ced-8912-a5a67cb8cbac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.302436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.304206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.304746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.305492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.307693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.310723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.317148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 66/122] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:27.317148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.323708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.324949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.325227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.325507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.326254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:27.326557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.327994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.335163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.338063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 57/123] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:27.338721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.442505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0afc-f2b5-4146-83e4-d3f1cce418c9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.462621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.476042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a448-2cc2-4131-85c8-a2b0993bffc2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.493379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.494220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.494540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.494812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.507416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:27.514402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:27.515355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:27.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 67/124] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:27.517283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.519592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.519592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.519592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.519592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.535709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:27.543340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:27.544305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:27.545545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 58/125] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:27.547357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.619855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.630250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfbb3a-2ba9-42a0-81dc-93263aa58d27 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.666662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.667385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354b3fb-05ce-465b-935a-e3eb43a8fff6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.667517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.667921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.668313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.669294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=5d6aaf0030ed4c769ac9ac28f7702f3a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:27.669707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.671257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.677155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/role_assignments?user.id=5d6aaf0030ed4c769ac9ac28f7702f3a&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:27.678112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.706023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.707048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.707609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.708056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.709618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.711266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.713553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 59/127] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:27.714586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.730913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:27.795550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd99d-a77c-415a-8bf7-3a56fa6463f4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.860092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:27.860748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:27.861035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:27.861310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:27.862000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:27.862306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:27.863707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:27.872987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 69/128] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:27.873872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:27.973601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad46af-0fe8-448d-ab11-304c1809bd00 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.986461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae37fe-5893-489f-a39b-bd776037eae5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:27.988964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.023197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.023835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.024120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.024393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.025594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.027121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.029630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 70/129] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.030426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.043410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.069451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.069995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.070277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.070550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.071223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:28.071524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.072941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.092454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 60/130] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.093247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.134788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd86ec-fba7-406f-a2ad-34181829f328 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.173911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.174660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.174943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.175374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.177110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.179020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.181048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 71/131] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:28 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.181741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.240681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.278926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3581c-ec36-467d-96ab-f53358a0500e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.322777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e823bfb-c2fe-4254-bcc1-cf013bf5fb90 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.348049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.349224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.349749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.350167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/users/1529def0a8464361b52f97a79ae54344/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.357881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, user_id=1529def0a8464361b52f97a79ae54344, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.360151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.361715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.362451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.362875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.363246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.369440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.371777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.373762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 72/132] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:28 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.374381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.386779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 61/133] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:28 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/users/1529def0a8464361b52f97a79ae54344/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:28.387824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.494840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fdb8f-5141-4ce7-8ec9-3a8c4e417e61 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.495484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.516790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.541529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.542248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.542538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.542876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] PATH_INFO: `/v3/projects/4a0362cbe96a43349d0641f93d187f4e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.544073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a0362cbe96a43349d0641f93d187f4e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.546344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.548259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 73/134] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:28 2022] GET /identity/v3/projects/4a0362cbe96a43349d0641f93d187f4e => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.554767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.618168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6216-3067-49b7-ba76-977aff0119c3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.697607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.698610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.699698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.700170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.701105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8c906-93e4-416d-9ea4-3a0c0d9132f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.702119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.703774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c35b03-e2ee-4aaf-94fa-9b8d8d37c4a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.705989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 62/135] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:28 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:28.707341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce8ce-a33e-4502-b3a2-a07c7ebe7274 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.707839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce8ce-a33e-4502-b3a2-a07c7ebe7274 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.708324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce8ce-a33e-4502-b3a2-a07c7ebe7274 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.714243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 63/136] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:28.716777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce8ce-a33e-4502-b3a2-a07c7ebe7274 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:28.738216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:28.738871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.739147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.739413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] PATH_INFO: `/v3/projects/4a0362cbe96a43349d0641f93d187f4e/users/1529def0a8464361b52f97a79ae54344/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.741404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] RBAC: Authorizing `identity:create_grant(project_id=4a0362cbe96a43349d0641f93d187f4e, user_id=1529def0a8464361b52f97a79ae54344, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:28.742914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858608b-924a-47de-bd55-cf4d3b9711de None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:28.762844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 74/137] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:28 2022] PUT /identity/v3/projects/4a0362cbe96a43349d0641f93d187f4e/users/1529def0a8464361b52f97a79ae54344/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:11:28.764018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:28.764278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:28.764546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:28.803641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:28.804761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:28.898752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:28.966855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ce8ce-a33e-4502-b3a2-a07c7ebe7274 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:28.990495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 75/138] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:28.998124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:29.022855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:29.023531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:29.023757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:29.024080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/users/1529def0a8464361b52f97a79ae54344/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:29.026443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, user_id=1529def0a8464361b52f97a79ae54344, role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:29.028543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:29.048291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 64/139] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:28 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/users/1529def0a8464361b52f97a79ae54344/roles/6c5ab00012a74672bf6dcbc47131673e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:11:29.309096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:29.431382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996981-44a7-4d79-81dd-2991432f473b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:29.469045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:29.469600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:29.469875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:29.470149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:29.471360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:29.472897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b17dfe-1fb4-4701-bbca-7f7ccec42c8e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:29.474759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 76/140] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:29.480218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:29.590355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73d244-5b40-4081-a0f9-d7dce6848810 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:29.625448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:29.626062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:29.626341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:29.626612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:29.627273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:29.629059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15e16f-80bd-473f-9f6b-2219825781f8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:29.657989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 65/141] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:29 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:30.395546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3444-994e-48ed-abae-703c28dbb72f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:30.396043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3444-994e-48ed-abae-703c28dbb72f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:30.396144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd3444-994e-48ed-abae-703c28dbb72f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:30.397650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 77/142] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:30.403064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62e99-8fc2-4daa-8d9c-40432be3c7bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:30.403574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62e99-8fc2-4daa-8d9c-40432be3c7bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:30.403794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62e99-8fc2-4daa-8d9c-40432be3c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:30.434251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-78e62e99-8fc2-4daa-8d9c-40432be3c7bb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:30.435478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-78e62e99-8fc2-4daa-8d9c-40432be3c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:30.480456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:30.544015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 66/143] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:30.619281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77b46-8063-47bd-b61b-dd74c0acacab None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:30.619920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77b46-8063-47bd-b61b-dd74c0acacab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:30.620392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce77b46-8063-47bd-b61b-dd74c0acacab None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:30.622635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 78/144] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:30.628144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:30.628434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:30.628739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:30.650151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:30.651357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:30.739317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 67/145] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:31.040565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77b46-8063-47bd-b61b-dd74c0acacab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.078535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:31.113704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.199714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce77b46-8063-47bd-b61b-dd74c0acacab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.275937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.276605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.276950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.277263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.299559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:31.309236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:31.310082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:31.311082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:31.312003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 79/146] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:31.319328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca44bd7-fab9-4c23-8783-967f108092da None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.320611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.369232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.369885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.370170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.370637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.383638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:31.392806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:31.393690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:31.394448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 68/147] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:31.399938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.502357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:31.513129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a9a25-6f02-4430-8543-05d1b2565673 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.537028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505e0d-be7c-40f4-b4c1-3339c8619fba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.558729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.559265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.559540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.559804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.560474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:31.560913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:31.562338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:31.573197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 80/148] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:31.588606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.589252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.589425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.590362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.590857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.591662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:31.592045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:31.593900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:31.606715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 69/149] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:31.615021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.648978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:31.766883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5d44-31e5-4b12-a487-ad10d0f7ccb2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.795808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f262c-f692-4707-a409-d84e744c2af8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:31.832340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.832915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.833251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.833525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] PATH_INFO: `/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.834734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] RBAC: Authorizing `identity:get_user(user_id=5d6aaf0030ed4c769ac9ac28f7702f3a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:31.836318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:31.837935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 81/150] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:31.844771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.863561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:31.864294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:31.864600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:31.864882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] PATH_INFO: `/v3/users/3ab5d70b339a4058a47f19e5d4098fad` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:31.866703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] RBAC: Authorizing `identity:get_user(user_id=3ab5d70b339a4058a47f19e5d4098fad)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:31.868418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:31.872399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 70/151] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/users/3ab5d70b339a4058a47f19e5d4098fad => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:31.879275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:31.895882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:32.060952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:32.075307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1247-a1b2-4ea3-8d0f-210f1f083d69 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:32.092002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2d981-dd05-43d5-9db8-e9d39e02caab None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:32.164659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:32.165303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.165586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.165860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.226289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:32.226937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.227215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.227486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.228675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:32.230133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b18763-8275-4063-90e0-74c464e8f2d9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:32.232281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 82/152] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:32.237614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b8e2-280c-4678-8506-ae37203cdc34 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.237899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b8e2-280c-4678-8506-ae37203cdc34 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.238178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b8e2-280c-4678-8506-ae37203cdc34 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.239611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 83/153] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:32.240122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705b8e2-280c-4678-8506-ae37203cdc34 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:32.291685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:32.293977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afefaa-06ec-4277-870a-2c30c8b2e435 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:32.433042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:32.456516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705b8e2-280c-4678-8506-ae37203cdc34 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:32.485006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:32.504128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:32.504812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.505103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.505439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/users/5d6aaf0030ed4c769ac9ac28f7702f3a/roles/8668698ff2614b9783e8b57cb7a755c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.507610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, user_id=5d6aaf0030ed4c769ac9ac28f7702f3a, role_id=8668698ff2614b9783e8b57cb7a755c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:32.509107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf956206-51f7-4cde-bd9d-077bddd1c333 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:32.516693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 71/154] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:32.520789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474915-ee82-4cdf-8022-1884cc90093c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.520978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474915-ee82-4cdf-8022-1884cc90093c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.521348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474915-ee82-4cdf-8022-1884cc90093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.538319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 84/155] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:32 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/users/5d6aaf0030ed4c769ac9ac28f7702f3a/roles/8668698ff2614b9783e8b57cb7a755c0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:32.539906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab579-1502-4f4f-9acb-fa50936b75a0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.544983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab579-1502-4f4f-9acb-fa50936b75a0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.545459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ab579-1502-4f4f-9acb-fa50936b75a0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.547080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 85/156] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:32.548039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ab579-1502-4f4f-9acb-fa50936b75a0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:32.563186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-93474915-ee82-4cdf-8022-1884cc90093c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:32.563186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-93474915-ee82-4cdf-8022-1884cc90093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:32.710445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 72/157] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:32.715538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.715538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.715538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.727531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ab579-1502-4f4f-9acb-fa50936b75a0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:32.770014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:32.771252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:32.790008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:32.790998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:32.791454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:32.791908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:32.793661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:32.795516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:32.797535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 86/158] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:32 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:32.804337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:32.836777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:32.948222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725e8b4-ca9c-4028-a9c7-9a25834ea598 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:32.994166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 73/159] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:33.023148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:33.023756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.024036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.024308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.025087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=3ab5d70b339a4058a47f19e5d4098fad) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:33.025396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:33.026826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4599a-4c34-4db0-baee-fa3cb18cd6dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:33.036953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 87/160] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:32 2022] GET /identity/v3/role_assignments?user.id=3ab5d70b339a4058a47f19e5d4098fad&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:33.404004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:33.463572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:33.519812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57be-f57f-42d2-b8d7-8af0bdc5b260 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.520341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57be-f57f-42d2-b8d7-8af0bdc5b260 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.520341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e57be-f57f-42d2-b8d7-8af0bdc5b260 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.520939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c9de-e82d-4278-8cd3-413c5317d6e9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:33.521743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 88/161] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:11:33.528546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.529066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.529550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.559990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:33.560954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.561405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.561869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.568804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:33.570396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:33.579423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:33.584963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:33.585797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:33.586543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:33.594150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 74/162] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:33.600334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:33.737753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb69b6-8f8d-4fc5-bd95-12d7f0760f42 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:33.740874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:33.782054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:33.782674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.782949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.783216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.783888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:33.784190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:33.785778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:33.796015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 75/163] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:33.801463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:33.814532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 89/164] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 19 11:11:33.815436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:33.850101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:33.920223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe6a8-85a6-44b8-86e6-c5af53ada4bd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:33.963892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:33.965512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:33.966003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:33.967829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:33.980466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:33.987566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:33.988693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:33.989651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:33.992390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 76/165] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:34.001343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.030966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3b56-878f-4327-95ae-6eed960f3102 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.048310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:34.117244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.118123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.118577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.119105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.123107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:34.124741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:34.126519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 90/166] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:33 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:34.136909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.182003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d7354-55f8-4ccc-be84-30d189fcaf75 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.262876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.263378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.263653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.263916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.264605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:34.264902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:34.271517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:34.287625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 77/167] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:34.293554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.316847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:34.351657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1765-4ad6-471e-a717-bc134ed3893b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.401118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.401730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.402006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.402802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.475437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:34.477097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3148483-6194-430d-b781-574967eb8ad8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:34.532725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:34.553584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d11ef-fab8-4236-8f1e-c076df7af59c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.640233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.640923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.641208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.641486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.645314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:34.646793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:34.647279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:34.648412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 78/168] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:34.649220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.656556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 91/169] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:11:34.662098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372067ff-6cbc-4345-849a-a75b6146c8be None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.662560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372067ff-6cbc-4345-849a-a75b6146c8be None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.663029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372067ff-6cbc-4345-849a-a75b6146c8be None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.666449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 92/170] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:34.667348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372067ff-6cbc-4345-849a-a75b6146c8be None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.783302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372067ff-6cbc-4345-849a-a75b6146c8be None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.828881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec030e10-6dd6-4cde-a0ca-8e2770fc2325 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:34.829803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.830629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.831326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.832704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.874344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:34.875378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:34.875836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:34.876853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:34.888920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:34.892322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:34.901469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:34.903173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:34.904115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:34.906129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 79/171] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:34.906746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:34.916990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:34.919438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594c741-0dab-4a22-9bb6-fd632198045c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:34.933078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.041155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 93/172] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:35.047531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.048041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd930a3-baaa-4312-bcb8-7b21c355bad1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.048152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.048601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.070712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:35.072115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:35.089072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.091247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.091920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.092401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] PATH_INFO: `/v3/projects/4a0362cbe96a43349d0641f93d187f4e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.093768 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] RBAC: Authorizing `identity:get_project(project_id=4a0362cbe96a43349d0641f93d187f4e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.095441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956991-f202-4072-b07d-46bc26c23797 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.097749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 80/173] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:34 2022] GET /identity/v3/projects/4a0362cbe96a43349d0641f93d187f4e => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.099459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734161da-ae0b-4568-bbac-fa9373ee4dc7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.099969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734161da-ae0b-4568-bbac-fa9373ee4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.100453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734161da-ae0b-4568-bbac-fa9373ee4dc7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.101900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 81/174] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:35.102781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734161da-ae0b-4568-bbac-fa9373ee4dc7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.174331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 94/175] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:35.181018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.215172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.244554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.275598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734161da-ae0b-4568-bbac-fa9373ee4dc7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.313577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.314113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.314395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.314670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.315449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:35.315760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.317247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819d173-bdae-4238-ae94-e39e019bc524 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.325856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7c376-8fe4-4e80-991c-146642a43bc7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.328208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 82/176] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.329869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49276-d8de-4c86-842e-a1bcf1f559e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.330299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49276-d8de-4c86-842e-a1bcf1f559e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.330729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b49276-d8de-4c86-842e-a1bcf1f559e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.350729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a9b49276-d8de-4c86-842e-a1bcf1f559e6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:35.352330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9b49276-d8de-4c86-842e-a1bcf1f559e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:35.368095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.368853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.369294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.369713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.371589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.373912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.375718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 95/177] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.377316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.435293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 83/178] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:35.437624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910ade-20e3-45b0-9172-2c2af2eabbf9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.438145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910ade-20e3-45b0-9172-2c2af2eabbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.438595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910ade-20e3-45b0-9172-2c2af2eabbf9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.440055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 84/179] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:35.445651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910ade-20e3-45b0-9172-2c2af2eabbf9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.494690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.533004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c909d04-1970-48f9-a9fe-05a4e656b94b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.573325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.581554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.582442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.582884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.583346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.584205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=4a0362cbe96a43349d0641f93d187f4e, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:35.584669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.586327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.594342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 96/180] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=4a0362cbe96a43349d0641f93d187f4e&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.595303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.612502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910ade-20e3-45b0-9172-2c2af2eabbf9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.680370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.681058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.681310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.681587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] PATH_INFO: `/v3/users/1529def0a8464361b52f97a79ae54344` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.685321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1529def0a8464361b52f97a79ae54344)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.686793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e50a1-9595-4bc2-b98b-a5096552d2d9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.689077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 85/181] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/users/1529def0a8464361b52f97a79ae54344 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.690525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.690967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.691381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.724541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:35.726195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:35.730647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2552-d144-46cd-b1a3-0a619c87525c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:35.784434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:35.785350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:35.785769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:35.786712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:35.787605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:35.788500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:35.790447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:35.799090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 97/182] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:35.805417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.832934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.838005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 86/183] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:35.841053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:35.957766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:35.992645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598f4a7-d2ee-4e6d-bb63-3cffbc076254 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.005450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144048f-97c6-4fd6-9606-827830405496 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.059387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.060007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.060284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.060552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.067220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.067853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.068129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.068397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.073839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.075899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.079824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 98/184] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:36.080933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.154875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.156934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.186354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.210620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff953c-e9ea-4fba-a7e9-7f0b223606be None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.238588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.245067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.245679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.246589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.247055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.257000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-83939015-fd52-4244-ac8b-4f1255092d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:36.262552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:36.263425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:36.264534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 99/185] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:36.265714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 87/186] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:36.265714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.269038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491165d-7249-4070-ba7b-ee478e267938 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.269384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491165d-7249-4070-ba7b-ee478e267938 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.269665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491165d-7249-4070-ba7b-ee478e267938 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.271098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 100/187] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:36.271763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491165d-7249-4070-ba7b-ee478e267938 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.364707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be57f3b-823a-409a-a842-4f46718bcf74 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.379188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491165d-7249-4070-ba7b-ee478e267938 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.409142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.409989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.410264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.410535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.411183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.412656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.413622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.414240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.414514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.414777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.417344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.427049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:36.431870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:36.432958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:36.434345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 101/188] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:36.435136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 88/189] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:36 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:36.435220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.437886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.473749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.550323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51944-1fbd-45b0-8d8c-6ac371392c3d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.551749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ee73-82ec-42fd-9486-86a28b1648e8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.586801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.587425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.587703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.588018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.588681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:36.588986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.589169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.590357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.590696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.590984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.591086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.592149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.593634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5367c-96e5-45b4-8b79-0c56d03fe2b5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.595480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 102/190] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:36.597960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.598246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.598775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.604403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 89/191] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:36.605860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.619560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:36.621356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:36.698903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.710041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 103/192] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:36.712034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.712393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:36.722571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9276f-9b50-4f08-8088-22ea91a5d44f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.771111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.771731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.772047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.772330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.773042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:36.773376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.774763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.785296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 90/193] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:36.786150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.850912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805dd62-29de-4e70-bcb5-a6f8203a71e0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:36.895198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:36.895954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:36.896319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:36.896704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:36.897527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=1529def0a8464361b52f97a79ae54344) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:36.898024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:36.899636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:36.910393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 104/194] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/role_assignments?user.id=1529def0a8464361b52f97a79ae54344&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:36.910393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:36.928052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c192a-2a37-4fd4-8a63-3dfa231953eb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.006161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.006724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.007001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.007271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.022353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.029813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.031310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.033468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 91/195] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.034411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.050250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.079795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790ef62-d176-4275-8d08-f908bb33fcf1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.118427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.119535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.120020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.120501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.123016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.124875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.126777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 105/196] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:36 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.127890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.179175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a70-5f39-4a79-a6cf-0237e089663c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.221881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.222520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.222777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.223046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.235548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:37.240450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:37.241336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:37.242115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:37.242706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 92/197] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:37.243238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.245298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e61b6-8d6e-4124-b8ea-942b1f50b552 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.277626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.284992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.285911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.286379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.286868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.320672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.352705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65e89-6dff-44ae-836f-f09b5df0d60a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.364273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.366160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.391272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.391889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.392262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.392431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.465585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.467075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.475974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 106/198] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:37.477201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.540984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.543155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.577080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 93/199] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:37.578155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.591366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b480f1-8e2a-4511-827b-bf16824fd5e7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.633784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.634758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.635231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.635784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.637276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:37.637768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.640079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.650211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 107/200] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.651334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.689643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578e126-b7b1-4099-8e92-928da16fcfbe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.725514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.726164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.726392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.726659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.727766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.729267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.731503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 94/201] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.732471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.772426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.782950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:37.791738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17461-4ffd-4deb-b372-a09a4f72e521 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.837997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.839406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.840312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.840810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.842761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.844830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.846674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 108/202] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.847277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.857431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7c69-112d-41fa-869b-191e838b5066 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:37.896132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:37.896994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:37.897412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:37.897773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] PATH_INFO: `/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:37.899424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=5d6aaf0030ed4c769ac9ac28f7702f3a)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:37.900561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:37.902656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 95/203] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/users/5d6aaf0030ed4c769ac9ac28f7702f3a => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:37.903502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:37.976904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0273d-059c-4a67-bd4f-d9e377914420 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:38.013816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:38.014650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:38.015226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:38.015638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:38.017110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=50f99f0583084d9e8b13514515611e71) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:38.017583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:38.018996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c89aa-44c8-4085-992c-5943707ae2b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:38.019310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:38.024890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 109/204] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/role_assignments?user.id=50f99f0583084d9e8b13514515611e71&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:38.025880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:38.036963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:38.096217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:38.096776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:38.097053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:38.097326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:38.098066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=50f99f0583084d9e8b13514515611e71) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:38.098898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:38.101184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:38.107015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:38.120765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 96/205] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:37 2022] GET /identity/v3/role_assignments?user.id=50f99f0583084d9e8b13514515611e71&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:38.233298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f83ad-ac8e-462d-acc4-4266c74bb174 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:38.275079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:38.276047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:38.276502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:38.277415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:38.353973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:38.357029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:38.380010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:38.465867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 110/206] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:38.477721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:38.621144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc5efd-ee22-4495-984f-ff52f3657286 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:38.664862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:38.665499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:38.665789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:38.666062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:38.669329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:38.670812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6bb01-a09e-46f3-af79-e5c264bbd6f6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:38.672482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 97/207] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:38 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:38.678520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:38.814196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244f88e-fed1-47a1-adb6-769a85a3a684 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:38.836462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:38.851585 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:38.852196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:38.852471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:38.852772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:38.853504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, scope.project.id=122667ff87e3416992a6a2c8507ca461, user.id=5d6aaf0030ed4c769ac9ac28f7702f3a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:38.853811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:38.855325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a010-b783-4f6d-9784-ad28805a9bec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:38.861803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 111/208] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:38 2022] GET /identity/v3/role_assignments?user.id=5d6aaf0030ed4c769ac9ac28f7702f3a&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:39.133571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e110-e05b-403d-bd1e-c1c8206368dd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.134108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e110-e05b-403d-bd1e-c1c8206368dd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.134108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630e110-e05b-403d-bd1e-c1c8206368dd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.135591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 98/209] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:39.141239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25d272-c50a-4aa1-9713-cfb196a53a1b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.141683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25d272-c50a-4aa1-9713-cfb196a53a1b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.141770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25d272-c50a-4aa1-9713-cfb196a53a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.163473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ce25d272-c50a-4aa1-9713-cfb196a53a1b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:39.164760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ce25d272-c50a-4aa1-9713-cfb196a53a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:39.242148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 112/210] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:39.457571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bba2-c7d2-4b23-9fec-a8ac0411149e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.457917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bba2-c7d2-4b23-9fec-a8ac0411149e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.458088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bba2-c7d2-4b23-9fec-a8ac0411149e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.459394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 99/211] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:39.465889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.466298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.466674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.487334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:39.488526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:39.534754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395bba2-c7d2-4b23-9fec-a8ac0411149e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:39.568290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 113/212] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:39.593028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:39.649509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395bba2-c7d2-4b23-9fec-a8ac0411149e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:39.685694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:39.686377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.686658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.686927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.697319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:39.702803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:39.703668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:39.704447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 100/213] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:39.711297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:39.757517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:39.822053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f569eab-dc15-4102-96f2-1e04b7b16ccf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:39.857726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:39.858377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:39.858664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:39.858961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:39.859751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:39.860056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:39.861444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:39.864937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:39.870965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 114/214] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:39.876970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:39.977031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:39.977201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d6651-b1b5-4ea5-9653-b0bcd25a1889 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:39.998667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab479-8bb6-4c64-9acc-5fc967fa1451 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:40.006566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:40.024489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.025431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.025715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.025990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.027341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.029448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.031623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 101/215] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:40.036923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:40.045167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.045800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.046078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.046351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] PATH_INFO: `/v3/users/f6c017dfd1374195b61264a766607c46` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.063753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c017dfd1374195b61264a766607c46)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.065540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.067620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 115/216] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:39 2022] GET /identity/v3/users/f6c017dfd1374195b61264a766607c46 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:40.072997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:40.152890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde106-7d05-4932-a898-7e37b538025f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:40.189453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.189999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.190283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.190557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.191210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.192604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb906-cb7a-42e8-b70f-2d05d3a36f20 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:40.193043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.229250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 102/217] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:40 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:40.241612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.242342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.242637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.242914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.282938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:40.325701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.327186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62d79c-80c0-472f-9704-2b74a82ef4ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.443327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 116/218] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:11:40.449873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:40.479069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:40.574669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14257946-2133-4003-9335-db73fb4b1c8a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:40.616901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.617883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.618417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.619131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.622247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50b7-f17f-45b3-9629-286dcb00abd0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.622247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50b7-f17f-45b3-9629-286dcb00abd0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.622247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c50b7-f17f-45b3-9629-286dcb00abd0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.623506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.624275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 117/219] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:40.625493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.627428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 103/220] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:40 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:40.629464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e716-a827-42a0-a4dd-c981f58dc42b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.629749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e716-a827-42a0-a4dd-c981f58dc42b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.630025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e716-a827-42a0-a4dd-c981f58dc42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.634149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:40.649674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-27b3e716-a827-42a0-a4dd-c981f58dc42b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:40.651019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27b3e716-a827-42a0-a4dd-c981f58dc42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:40.723870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:40.732338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 118/221] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:40.733548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2efe-739b-45c5-bf25-512a5ecb58d6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.733840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2efe-739b-45c5-bf25-512a5ecb58d6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.734118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2efe-739b-45c5-bf25-512a5ecb58d6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.735491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 119/222] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:40.741107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.741894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.742356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.750897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:40.762172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d922b9-a7c5-488c-a88e-25a71cdb8597 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:40.766272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:40.767662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:40.800128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:40.800767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:40.801052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:40.801328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:40.802076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=f6c017dfd1374195b61264a766607c46) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:40.802387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:40.803912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:40.811752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 104/223] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:40 2022] GET /identity/v3/role_assignments?user.id=f6c017dfd1374195b61264a766607c46&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:40.853015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 120/224] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:41.032250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.166062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0591d-fd8c-450f-be29-ec1897175fc0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.203052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.203692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.203975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.204249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.221405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:41.226861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:41.227318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:41.228117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:41.228924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 105/225] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:41.243029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.281044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:41.419955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279c4b-a9e2-475b-8876-edfdb21c5b7c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.439456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339dfdd-c3cf-45d4-8e82-40d2a433c247 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.465842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:41.490934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.491917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.492388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.492877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.493915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:41.494420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:41.496054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:41.505312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.505962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.506353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.506537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.506725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 106/226] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:41.513421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.529856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:41.534953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:41.535899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:41.536716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 121/227] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:41.545644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.611666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:41.642014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f2dc-e013-4d05-b7a5-a4ea566ed4dc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.718224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631643c-5940-498e-8259-88d230b8250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.719287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631643c-5940-498e-8259-88d230b8250d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.721243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631643c-5940-498e-8259-88d230b8250d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.721718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631643c-5940-498e-8259-88d230b8250d None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.724463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631643c-5940-498e-8259-88d230b8250d None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:41.727070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631643c-5940-498e-8259-88d230b8250d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:41.734352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 107/228] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:41.745503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631643c-5940-498e-8259-88d230b8250d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.753846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456cbe1-9782-4c4f-80ad-aaadb862e03e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.791155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.792148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.792691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.793149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.794126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:41.794617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:41.796191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:41.806069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 122/229] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:41.813132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:41.867631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:41.926716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b96d25-fdf4-44b6-aa0a-c7aecd90dd4b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:41.964347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:41.965593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:41.966067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:41.966534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:41.968017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:41.970429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:41.972442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 123/230] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:41.979227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:42.025526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631643c-5940-498e-8259-88d230b8250d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:42.087957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1fe-61b5-4d75-9c7b-9099f8cd8507 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:42.112974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:42.124941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:42.125880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.126350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.126807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.128120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:42.129927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:42.132017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 124/231] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:42.137783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:42.142316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:42.142978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.143267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.143551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.149261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:42.150719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:42.152497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 108/232] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:41 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:42.160313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:42.196920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:42.317253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09b1d-f5b6-4401-b3e6-0b77927d1c6f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:42.347459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791a3c6-e441-42e5-8533-352463bbd7a9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:42.355997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:42.357228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.357581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.357955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/50f99f0583084d9e8b13514515611e71/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.361283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, user_id=50f99f0583084d9e8b13514515611e71, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:42.362865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12501e-7239-4833-ba06-ab0232beccc5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:42.379935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 109/233] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:42 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/50f99f0583084d9e8b13514515611e71/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:42.414598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:42.415294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.415572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.415842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/50f99f0583084d9e8b13514515611e71/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.420620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, user_id=50f99f0583084d9e8b13514515611e71, role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:42.422176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bca8e-89fc-4bde-b9e7-f11135b4c656 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:42.443523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 125/234] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:42 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/50f99f0583084d9e8b13514515611e71/roles/6c5ab00012a74672bf6dcbc47131673e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:42.944893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940782a-c8dd-492c-9b24-be3d080eaa89 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.945587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940782a-c8dd-492c-9b24-be3d080eaa89 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.946073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940782a-c8dd-492c-9b24-be3d080eaa89 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.947838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 110/235] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:42.954224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325fe9-5377-4c10-bcfc-a6876822e572 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:42.954794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325fe9-5377-4c10-bcfc-a6876822e572 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:42.955269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b325fe9-5377-4c10-bcfc-a6876822e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:42.981714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7b325fe9-5377-4c10-bcfc-a6876822e572 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:42.983254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7b325fe9-5377-4c10-bcfc-a6876822e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:43.023613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122da19-89ee-4648-a8e0-5cabcf031a39 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.023940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122da19-89ee-4648-a8e0-5cabcf031a39 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.024157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122da19-89ee-4648-a8e0-5cabcf031a39 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.025666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 111/236] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:43.030528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.030810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.031086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.036832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:43.057254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:43.059040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:43.099175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 126/237] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:43.147946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 112/238] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:43.454348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052add9-0b7b-4e86-acbf-be96ff700363 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.454856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052add9-0b7b-4e86-acbf-be96ff700363 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.454856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052add9-0b7b-4e86-acbf-be96ff700363 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.456335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 127/239] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:43.469950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:43.471887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.472164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.472434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.492100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:43.504393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:43.505604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:43.592150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 128/240] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:43.593049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:43.614973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94865424-22bb-4eb7-b780-5ca4879fb38f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:43.653178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:43.653845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.654340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.654608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.666595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:43.671791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:43.672688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:43.673514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 113/241] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:43.679226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:43.747103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:43.793118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab5b-d9c5-402c-9d45-03f15545ef99 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:43.831541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb0d6-1097-403a-a277-45863624565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:43.832151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb0d6-1097-403a-a277-45863624565d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.832426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb0d6-1097-403a-a277-45863624565d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.832726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb0d6-1097-403a-a277-45863624565d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.833386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb0d6-1097-403a-a277-45863624565d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:43.833681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb0d6-1097-403a-a277-45863624565d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:43.835055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb0d6-1097-403a-a277-45863624565d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:43.844758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 114/242] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:43.850992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb0d6-1097-403a-a277-45863624565d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:43.925458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42d5a-f3bd-4443-9513-f3af6add9527 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:43.929275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:43.960494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb0d6-1097-403a-a277-45863624565d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:43.982101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:43.983427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:43.984119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:43.984534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:43.986487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:43.988603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:43.989263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:43.996639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 129/243] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:43.996639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.002919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.003531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.003820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.004096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] PATH_INFO: `/v3/users/c3812651e23d41a2818e7288cb8242c0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.021095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] RBAC: Authorizing `identity:get_user(user_id=c3812651e23d41a2818e7288cb8242c0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.022704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.029253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 115/244] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:43 2022] GET /identity/v3/users/c3812651e23d41a2818e7288cb8242c0 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:44.030331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.123703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea3-8851-4051-86e6-83b63b1327c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.142974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ea688-276b-4427-9aac-122bf16f8ddc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.164185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.164848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.165129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.165400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.178447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:44.181037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.181829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.182274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.182726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:44.183903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:44.184903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:44.185775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 130/245] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:44.186430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.187354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.189139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.214902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 116/246] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:44 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:44.216633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.224972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.287619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.312126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49007e-8d84-48a7-8de6-f7a453ad594a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.353708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.354539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.354883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.355777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.357718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fec022-9b07-4dc9-89b0-0253195ceb6c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.394411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.395372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.395786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.396193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.397153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:44.397664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.399227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.408552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 117/247] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:44.418249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.450358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.451866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.507040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.580046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cfc9-f1cd-4847-9be5-b5282120fc03 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.581705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.595453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 131/248] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:44.601411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.625939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.626579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.626860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.627135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] PATH_INFO: `/v3/users/f6c017dfd1374195b61264a766607c46` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.628920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] RBAC: Authorizing `identity:get_user(user_id=f6c017dfd1374195b61264a766607c46)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.630651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.632713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 118/249] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/users/f6c017dfd1374195b61264a766607c46 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:44.639665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.722001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e395a-5fd5-479e-b001-c7a52444dadc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.757223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.766140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.767143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.767619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.768140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.769306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e87df-7313-4618-87f7-434363aea98e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.769772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.772566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.774764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 132/250] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:44.780842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.818068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.818710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.818994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.819271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.823602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.825255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.828651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 119/251] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:44.836684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:44.895317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:44.924386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb39e-c09b-4ef7-82b3-13c37d4f7845 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:44.963120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:44.963803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:44.964084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:44.964889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:44.965624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=c3812651e23d41a2818e7288cb8242c0) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:44.965929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:44.967599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baf22c-da50-41a4-8376-371e8f596c9c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:44.974431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 133/252] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:44 2022] GET /identity/v3/role_assignments?user.id=c3812651e23d41a2818e7288cb8242c0&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:44.993001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84684093-0422-4f6d-8a5b-b21bfb7ae525 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:45.037294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:45.037970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.038244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.038510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/f6c017dfd1374195b61264a766607c46/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.041487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, user_id=f6c017dfd1374195b61264a766607c46, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:45.043116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1653c-4231-4428-bb4f-69c419d7adfe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:45.060964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 120/253] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:44 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/f6c017dfd1374195b61264a766607c46/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:11:45.091396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a5bf-a0e9-49b9-9362-1c984fa5ff46 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.091678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a5bf-a0e9-49b9-9362-1c984fa5ff46 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.091863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a5bf-a0e9-49b9-9362-1c984fa5ff46 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.093636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 134/254] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:45.100687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0bf28-9c1d-45b6-9bbf-9aa50ec3dcb2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.101066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0bf28-9c1d-45b6-9bbf-9aa50ec3dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.101221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0bf28-9c1d-45b6-9bbf-9aa50ec3dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.122258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-31d0bf28-9c1d-45b6-9bbf-9aa50ec3dcb2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:45.123528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-31d0bf28-9c1d-45b6-9bbf-9aa50ec3dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:45.216836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 121/255] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:45.394604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7535-27dd-4df2-afe9-06082a7ebae1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.395250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7535-27dd-4df2-afe9-06082a7ebae1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.395726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c7535-27dd-4df2-afe9-06082a7ebae1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.397541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 135/256] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:45.402981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.403547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.404019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.426667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:45.428169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:45.453649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:45.509926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 122/257] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:45.539336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7535-27dd-4df2-afe9-06082a7ebae1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:45.607974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:45.651161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c7535-27dd-4df2-afe9-06082a7ebae1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:45.698239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:45.699703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.700009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.700253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.714572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:45.720100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:45.721016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:45.722175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 136/258] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:45.727464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:45.852308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b108e-441d-482c-a8bc-f81ae5334914 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:45.888406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:45.889043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:45.889320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:45.889589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:45.890257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:45.890555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:45.891937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:45.900408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 123/259] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:45.906509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:45.949662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:45.992938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:46.107097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9c25b-d8ef-4d6c-a0c4-b4d4750ef1ac None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.147661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:46.169234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665b142-fb18-4e07-a2fd-c9a4667e6622 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.173378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:46.174031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:46.174300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:46.174589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:46.177385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:46.178825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:46.181612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 137/260] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:45 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:46.186809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:46.263204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:46.263846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:46.264201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:46.264391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:46.289735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:46.296606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:46.297469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:11:46.298317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:46.303552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 124/261] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:46.309636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:46.342815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8ecc9-bd6e-471a-980a-9b22a82c70b1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.406285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:46.406904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:46.407178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:46.407445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:46.537091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:46.537261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:46.550245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:46.551689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:46.601807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb97533-34df-4fa0-9e8d-48409de613d0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.676400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:46.677444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:46.677930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:46.678923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:46.680080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:46.680605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:46.682434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:46.700762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 125/262] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:46.706420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:46.753260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 138/263] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:11:46.765143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:46.901639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea5f6-b621-4f26-8d6e-5890d2fbc78c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.930390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:46.951482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c717-1dd2-473a-91c6-e764e1e5fb77 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:46.978278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:46.978920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:46.979196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:46.979465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] PATH_INFO: `/v3/users/50f99f0583084d9e8b13514515611e71` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:46.985389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] RBAC: Authorizing `identity:get_user(user_id=50f99f0583084d9e8b13514515611e71)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:46.986859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:46.988972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 126/264] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:46 2022] GET /identity/v3/users/50f99f0583084d9e8b13514515611e71 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:46.996763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:47.014492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:47.015132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:47.015406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:47.015674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:47.016832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:47.018287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:47.020691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 139/265] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:46 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:47.022629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:47.027404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:47.187042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30edc-a990-441b-9ae3-eb3abe13b769 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:47.200311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6cdf5-f988-453f-b642-ea5eea491d34 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:47.256398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:47.257021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:47.257297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:47.257566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:47.258288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=50f99f0583084d9e8b13514515611e71) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:47.258592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:47.260773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:47.261598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:47.261878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:47.262245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:47.264129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:47.272545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 140/266] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:47 2022] GET /identity/v3/role_assignments?user.id=50f99f0583084d9e8b13514515611e71&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:47.372732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:47.374245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:47.387992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:47.499390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 127/267] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:11:47.504879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:47.533713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:47.616781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6330-397f-425a-80a0-31df68dddc77 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:47.651786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:47.652455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:47.652758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:47.653028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:47.654149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:47.655582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151f40-c939-43f6-b315-f4799213c3f0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:47.658065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 141/268] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:47 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:47.664949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:47.803916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759fd81-ffb4-4da6-834c-fbe2bacee6d5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:47.816284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:47.873732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:47.874610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:47.875023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:47.875420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:47.876656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=50f99f0583084d9e8b13514515611e71) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:47.877123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:47.879422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e96d5-c513-472c-a6ef-262d28f286bc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:47.888529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 128/269] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:47 2022] GET /identity/v3/role_assignments?user.id=50f99f0583084d9e8b13514515611e71&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:48.097734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289ac7-e311-41b4-b58a-b1bf38005a1e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.098088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289ac7-e311-41b4-b58a-b1bf38005a1e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.098205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289ac7-e311-41b4-b58a-b1bf38005a1e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.099781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 142/270] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:48.118560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4412-8f0c-4663-b2ea-8315cfa84285 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.119061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4412-8f0c-4663-b2ea-8315cfa84285 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.119135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada4412-8f0c-4663-b2ea-8315cfa84285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.149862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4ada4412-8f0c-4663-b2ea-8315cfa84285 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:48.151094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4ada4412-8f0c-4663-b2ea-8315cfa84285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:48.275690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 129/271] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:48.307260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2752af-377f-4782-886b-2e50b05b0a0a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.307681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2752af-377f-4782-886b-2e50b05b0a0a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.308147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2752af-377f-4782-886b-2e50b05b0a0a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.310764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 143/272] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:48.318094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2eded-df1b-423f-a97a-32cd33218a31 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.318698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2eded-df1b-423f-a97a-32cd33218a31 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.319166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2eded-df1b-423f-a97a-32cd33218a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.341656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b9d2eded-df1b-423f-a97a-32cd33218a31 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:48.343167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b9d2eded-df1b-423f-a97a-32cd33218a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:48.374997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2bec-14c7-495b-9d5a-809b905b3ad3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.375572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2bec-14c7-495b-9d5a-809b905b3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.376058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c2bec-14c7-495b-9d5a-809b905b3ad3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.377640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 144/273] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:48.386949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.387924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.388206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.411769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:48.413034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:48.425746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 130/274] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:48.427565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56fe3e-8749-4328-8366-0c22e24b06f3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.428042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56fe3e-8749-4328-8366-0c22e24b06f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.428523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56fe3e-8749-4328-8366-0c22e24b06f3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.430376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 131/275] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:48.439739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.440678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.441159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.467527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:48.469095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:48.497195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 145/276] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:48.505769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:48.551834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 132/277] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:48.609626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:48.641381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:48.722647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74e5c-e561-4a00-a8c2-4ff3a1e98632 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:48.727257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:48.765689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:48.766317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.766595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.766869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.777965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:48.783096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:48.784044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:48.784870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 146/278] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:48.793039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:48.840793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654b74d-c60f-4647-a34f-67f60c13c098 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:48.874941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:48.875675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.876031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.876310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.877575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:48.879094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:48.879608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:48.881114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 133/279] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:48.881680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:48.899943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68ab50-fc21-44ef-8bb7-d005f0594808 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:48.913999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:48.935363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:48.935951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:48.936224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:48.936488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:48.937176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:48.937744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:48.939107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:48.947013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 147/280] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:48.949773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:48.984446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955ed-1f9c-4306-8534-5fbec259875e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.018400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.019016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.019289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.019552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.029547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:49.034408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:49.035266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:49.036089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 134/281] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:49.036764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.051599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611c00a-8729-40cc-8fc9-2fb82f333761 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.085495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.086112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.086390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.086659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.097086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:49.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:49.103558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:49.104336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 148/282] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:49.105673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.107600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.128885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.137967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02343f0-c112-4d11-a49c-fb5b51bbafcf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.171275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.171805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.172088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.172362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.173044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.174494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.196260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 135/283] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:11:49 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:49.197132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.212541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fd1e4-bb68-4a03-bd33-65317f5d7b09 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.251321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.251971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.252254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.252527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] PATH_INFO: `/v3/users/37157c6b03e4457fbbc1c5f0080be31c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.268333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] RBAC: Authorizing `identity:get_user(user_id=37157c6b03e4457fbbc1c5f0080be31c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.269981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.276650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 149/284] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/users/37157c6b03e4457fbbc1c5f0080be31c => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.278122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.326109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebd74c-1e80-4216-bc7a-49a7e2ff9c4f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.346017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.364290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.364945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.365224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.365497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.366170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:49.366477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.367878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.377958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 136/285] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.378793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.394952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945fa2e-f382-4284-8719-66c4fcdca72f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.397419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.440693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.440693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.440693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.441044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.441671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:49.441831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.443676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.453525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 150/286] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.454194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.510488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e45dd-9a8f-43c8-ade5-62f62e169a0d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.554731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.555424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.555556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.555780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.556507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, user.id=37157c6b03e4457fbbc1c5f0080be31c, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:49.556995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.558371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.564213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 137/287] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/role_assignments?user.id=37157c6b03e4457fbbc1c5f0080be31c&scope.system=all&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.564842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.588309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69babd88-e2dd-446f-a959-07a1853cb300 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.624726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.643546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.645192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.645636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.646298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] PATH_INFO: `/v3/users/c3812651e23d41a2818e7288cb8242c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.648496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] RBAC: Authorizing `identity:get_user(user_id=c3812651e23d41a2818e7288cb8242c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.650192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.653855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 151/288] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/users/c3812651e23d41a2818e7288cb8242c0 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.664799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.670373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.703891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2670e-5264-4596-a992-61299a75fc28 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.746849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.748077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.749155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.749588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] PATH_INFO: `/v3/users/f6c017dfd1374195b61264a766607c46` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.757376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] RBAC: Authorizing `identity:get_user(user_id=f6c017dfd1374195b61264a766607c46)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.759865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.762330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 138/289] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/users/f6c017dfd1374195b61264a766607c46 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.768092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:49.856039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716662f5-4910-4bb2-a857-3463e60f9725 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.895245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cae21-0174-4dcd-abd4-6e8bf31d036f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:49.931659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.932276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.932556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.932854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.948620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:49.949980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:49.950407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:49.950680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:49.957348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:49.957900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:49.958770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:49.961006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 152/290] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:49.967760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:50.060613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:50.061438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:50.063185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:50.116011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab378f3-8aa4-4500-acf7-31c8818845af None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:50.155079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:50.155753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:50.156024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:50.156291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/c3812651e23d41a2818e7288cb8242c0/roles/8668698ff2614b9783e8b57cb7a755c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:50.158952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, user_id=c3812651e23d41a2818e7288cb8242c0, role_id=8668698ff2614b9783e8b57cb7a755c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:50.160402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:50.186245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 153/291] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:11:49 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/users/c3812651e23d41a2818e7288cb8242c0/roles/8668698ff2614b9783e8b57cb7a755c0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:11:50.259907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 139/292] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:50.266281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:50.376635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dd8c-654b-4a4e-bfb8-2000e9a623c3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:50.400988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:50.421325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:50.421963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:50.422239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:50.422508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:50.423615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:50.425073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f10572-4c4b-4fc0-a8c2-acda869c9b2b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:50.427031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 154/293] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:50 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:50.432605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:50.508786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:50.578196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd9b4c-19ed-4602-bac5-e6ea8825341c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:50.620878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:50.621608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:50.621887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:50.622156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:50.622876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=f6c017dfd1374195b61264a766607c46) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:50.623176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:50.624629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deaf4f-4ce1-4e50-ae94-68057bb41d99 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:50.635666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 140/294] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:50 2022] GET /identity/v3/role_assignments?user.id=f6c017dfd1374195b61264a766607c46&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:51.775589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fa237-b603-4cd0-ae66-5ee4b46e8304 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:51.776112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fa237-b603-4cd0-ae66-5ee4b46e8304 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:51.776112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fa237-b603-4cd0-ae66-5ee4b46e8304 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:51.777662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 155/295] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:51.783538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b541-d97f-4074-9dab-965064285b20 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:51.784087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b541-d97f-4074-9dab-965064285b20 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:51.784087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b541-d97f-4074-9dab-965064285b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:51.808099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-43a1b541-d97f-4074-9dab-965064285b20 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:51.810117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-43a1b541-d97f-4074-9dab-965064285b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:51.894682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 141/296] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:51.914836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375266-659e-4a7f-ba46-52e76d8872bb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:51.915121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375266-659e-4a7f-ba46-52e76d8872bb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:51.915377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14375266-659e-4a7f-ba46-52e76d8872bb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:51.918751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 156/297] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:51.922990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ab88-a003-4d6d-a74f-3eacb7edef5e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:51.923276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ab88-a003-4d6d-a74f-3eacb7edef5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:51.923546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870ab88-a003-4d6d-a74f-3eacb7edef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:51.942243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f870ab88-a003-4d6d-a74f-3eacb7edef5e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:51.943422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f870ab88-a003-4d6d-a74f-3eacb7edef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:51.973998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:52.015865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 142/298] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:52.145658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11d87-b47e-42dd-b5a2-52d65050fddb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.146103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11d87-b47e-42dd-b5a2-52d65050fddb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.146472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11d87-b47e-42dd-b5a2-52d65050fddb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.147907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 157/299] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:52.154541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.154833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.155107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.174017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:52.175205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:52.182016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11d87-b47e-42dd-b5a2-52d65050fddb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.274941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 143/300] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:52.288088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.304075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11d87-b47e-42dd-b5a2-52d65050fddb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.342055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.342680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.342958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.343229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.358131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:52.364666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:52.365528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:52.366332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:52.369017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 158/301] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:52.378290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.398377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:52.405923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4fd67-60b6-418a-b149-27d17bf3f65e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.436274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:52.446379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.447295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.447583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.447856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.449271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:52.451340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:52.453406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 144/302] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:52.458853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.510534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1cfa-6e96-4f38-bc89-f9ffa2f9d381 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.545681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.546591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.546863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.547155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.547810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:52.548251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:52.549777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:52.558740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 159/303] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:52.565076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.583859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5506f-94a2-4bd7-8e42-431d7fbc4cb3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.618525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.619137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.619414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.619683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] PATH_INFO: `/v3/groups` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.620313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:52.622411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:52.642949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 145/304] 10.222.0.71 () {60 vars in 1134 bytes} [Mon Sep 19 11:11:52 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:52.644033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.682679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222483f-cc3d-492d-97fb-f34d07640b14 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.695363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:52.697949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:52.729003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.730579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.731072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.731549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] PATH_INFO: `/v3/users/a997c51845ef4e678739e025bbe8d25d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.749612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] RBAC: Authorizing `identity:get_user(user_id=a997c51845ef4e678739e025bbe8d25d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:52.751120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:52.753263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 160/305] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/users/a997c51845ef4e678739e025bbe8d25d => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:52.762310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.811260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b455e-fdc1-471c-bb57-daedb6f3a68e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.855844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.856491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.856816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.857090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.870103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8309e622-9373-4b50-a1a9-d805737d7f6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:52.875718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:52.876707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:52.877636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 146/306] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:52.878440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189b2ef-b91e-4979-8c51-ba91b91f1f95 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.878722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189b2ef-b91e-4979-8c51-ba91b91f1f95 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.878987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189b2ef-b91e-4979-8c51-ba91b91f1f95 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.879481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f4dc-a929-41aa-8708-c0261e3343e8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:52.884472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 147/307] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:52.884472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189b2ef-b91e-4979-8c51-ba91b91f1f95 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:52.920450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:52.921072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.921350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.921620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.922343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, user.id=a997c51845ef4e678739e025bbe8d25d, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:52.922652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:52.924087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac8274-f43e-4ed5-8f8b-2b25582548a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:52.934304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 161/308] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/role_assignments?user.id=a997c51845ef4e678739e025bbe8d25d&scope.system=all&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:52.934304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:52.934304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:52.934304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:52.958990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:52.960224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:52.991692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.014090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189b2ef-b91e-4979-8c51-ba91b91f1f95 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.016981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.060420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.061048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.061324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.061921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.062264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:53.062561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:53.063939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:53.064980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 162/309] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:53.076657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 148/310] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:53.081981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.185740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26fb43-8020-426f-a86f-92e09c223e19 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.224472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.225125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.225400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.225665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] PATH_INFO: `/v3/users/37157c6b03e4457fbbc1c5f0080be31c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.226791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] RBAC: Authorizing `identity:get_user(user_id=37157c6b03e4457fbbc1c5f0080be31c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:53.228232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:53.230225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 163/311] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:53 2022] GET /identity/v3/users/37157c6b03e4457fbbc1c5f0080be31c => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:53.235802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.340781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea691d-b6f4-4f23-9b47-9e79d36e2b21 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.344051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.377325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.378308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.378679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.378962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.379612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] PATH_INFO: `/v3/system/users/37157c6b03e4457fbbc1c5f0080be31c/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.381131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37157c6b03e4457fbbc1c5f0080be31c, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:53.382633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:53.397115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 149/312] 10.222.0.71 () {58 vars in 1334 bytes} [Mon Sep 19 11:11:53 2022] PUT /identity/v3/system/users/37157c6b03e4457fbbc1c5f0080be31c/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:53.475729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc775-e5a2-462f-9722-340809c42c59 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.518668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.519748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.520336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.520840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.533966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:53.539592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:53.540611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:53.541431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:53.545330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 164/313] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:53.551488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.566864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.665924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238abfcc-3e7c-4457-8637-37316089adcd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.703044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.704036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.704532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.705035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.705901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:53.706402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:53.707996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:53.718081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 150/314] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:53.724258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.819978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.833778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb7be-f9e5-4765-9e8b-a87ff79e54f5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:53.869603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:53.871199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:53.871687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:53.872160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] PATH_INFO: `/v3/users/c3812651e23d41a2818e7288cb8242c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:53.873805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] RBAC: Authorizing `identity:get_user(user_id=c3812651e23d41a2818e7288cb8242c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:53.875631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:53.877684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 165/315] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:53 2022] GET /identity/v3/users/c3812651e23d41a2818e7288cb8242c0 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:53.883723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:53.959040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:53.991707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40be61-0554-4ee8-815b-85ac165203e7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:54.028364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:54.029063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:54.029346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:54.029617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:54.099708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:54.101199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:54.172936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:54.205650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 151/316] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:11:54.211233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:54.325422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f396-acb2-4227-a72e-5efa7d899b99 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:54.364420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:54.364927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:54.365209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:54.365482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:54.366629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:54.368077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa85e-950a-4114-8d7d-3fff588080ac None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:54.370045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 166/317] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:11:54 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:54.376397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:54.478238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa57d9f-109a-478b-8316-366b4c5a4fdd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:54.513686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:54.514292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:54.514572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:54.514846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:54.515570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, scope.project.id=db12b0cd5fef4105939a9f08138e2086, user.id=c3812651e23d41a2818e7288cb8242c0) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:54.515876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:54.517360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1e645-2f8e-4702-8bc1-95140c121b5a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:54.523322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 152/318] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:11:54 2022] GET /identity/v3/role_assignments?user.id=c3812651e23d41a2818e7288cb8242c0&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:54.954748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c89c-c3f8-4adc-ade8-4c6d4490f851 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:54.955169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c89c-c3f8-4adc-ade8-4c6d4490f851 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:54.955270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c89c-c3f8-4adc-ade8-4c6d4490f851 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:54.956773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 167/319] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:54.961793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8008332-4a9a-4b73-818c-9f63727d13c9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:54.962223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8008332-4a9a-4b73-818c-9f63727d13c9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:54.962379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8008332-4a9a-4b73-818c-9f63727d13c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:54.981450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c8008332-4a9a-4b73-818c-9f63727d13c9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:54.982613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c8008332-4a9a-4b73-818c-9f63727d13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:55.015790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:55.056042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 153/320] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:55.211819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7d4c-f15f-4b92-a941-4102af402f22 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.212271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7d4c-f15f-4b92-a941-4102af402f22 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.212366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d7d4c-f15f-4b92-a941-4102af402f22 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.213907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 168/321] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:55.219571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.219886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.220166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.239294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:55.240480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:55.310326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 154/322] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:55.323457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7d4c-f15f-4b92-a941-4102af402f22 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:55.349922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:55.432046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d7d4c-f15f-4b92-a941-4102af402f22 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:55.466986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:55.467524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.467802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.468071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.469162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:55.470593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:55.476790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 169/323] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:11:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:55.478604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:55.579380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:55.581380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:55.587632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd08b53-62b4-4610-bb8e-9851b4484889 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:55.626115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:55.627108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.627398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.627672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] PATH_INFO: `/v3/groups` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.628738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:55.630196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f744a5-cc46-4a99-9da8-dd64d83f31c9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:55.646530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 155/324] 10.222.0.71 () {60 vars in 1134 bytes} [Mon Sep 19 11:11:55 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:11:55.647802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef001-497f-4cab-9ba0-4313266fb6e4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.648093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef001-497f-4cab-9ba0-4313266fb6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.648364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ef001-497f-4cab-9ba0-4313266fb6e4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.652617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 156/325] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:55.656192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.656548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.656928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.676119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:55.677394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:55.686426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:55.697291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec41e-4557-4df1-9fb6-5ce56a0e5986 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:55.737874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:55.738419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.739220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.739497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.752809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:55.753736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 157/326] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:55.757859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:55.758800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:55.762115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 170/327] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:55.765494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:55.859561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:55.878314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147ce22-3553-4c2e-88d4-4f6bef574413 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:55.913463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:55.913973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:55.914246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:55.914509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:55.915162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:55.915463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:55.916868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:55.926395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 158/328] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:55.931526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.033660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.041880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab33ba-04f4-4592-a115-a78a182cc9db None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.087925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.088555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.088856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.089123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] PATH_INFO: `/v3/users/a997c51845ef4e678739e025bbe8d25d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.090724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] RBAC: Authorizing `identity:get_user(user_id=a997c51845ef4e678739e025bbe8d25d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:56.092159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:56.094139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 171/329] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:55 2022] GET /identity/v3/users/a997c51845ef4e678739e025bbe8d25d => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:56.099610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.127578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:56.163280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae03a99-e091-42c5-b759-ff2f1a9c1205 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.208272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.208954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.209238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.209478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.226352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:56.232515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:56.233459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:11:56.234246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 159/330] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:11:56.239362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffce30-8188-4cd3-9b8a-4947e1879685 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.241691 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.259743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:56.287338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.288003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.288345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.289582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] PATH_INFO: `/v3/system/users/a997c51845ef4e678739e025bbe8d25d/roles/8668698ff2614b9783e8b57cb7a755c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.290304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a997c51845ef4e678739e025bbe8d25d, role_id=8668698ff2614b9783e8b57cb7a755c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:56.291795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:56.304528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 172/331] 10.222.0.71 () {58 vars in 1334 bytes} [Mon Sep 19 11:11:56 2022] PUT /identity/v3/system/users/a997c51845ef4e678739e025bbe8d25d/roles/8668698ff2614b9783e8b57cb7a755c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:11:56.407261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81fc22-665c-49d5-b921-5d74c9945a13 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.454842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.455467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.455753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.456024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.456804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:56.457109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:56.458568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:56.473199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 160/332] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:56.478858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.580386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:56.598976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96423f7b-d50c-4ca8-a524-c9b4dd0443e8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.642648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.642648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.642909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.643147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] PATH_INFO: `/v3/users/37157c6b03e4457fbbc1c5f0080be31c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.644816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] RBAC: Authorizing `identity:get_user(user_id=37157c6b03e4457fbbc1c5f0080be31c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:56.646259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad07b7-61fd-44c2-8ca9-f41c32f021dc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:56.647839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 173/333] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:11:56 2022] GET /identity/v3/users/37157c6b03e4457fbbc1c5f0080be31c => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:56.654781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:56.753965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:56.798001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e1d16-4a83-4198-a9b1-dd5d6acd3a96 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:56.835917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:56.836882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:56.837380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:56.837847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:56.838763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] RBAC: Adding query filter params (role.id=fab8c6e936c1459c88d7b63932c49458, user.id=37157c6b03e4457fbbc1c5f0080be31c, scope.system=all) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:56.839811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:56.841469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17381-418d-4020-b251-5a944eb2ed09 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:56.859573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 161/334] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Sep 19 11:11:56 2022] GET /identity/v3/role_assignments?user.id=37157c6b03e4457fbbc1c5f0080be31c&scope.system=all&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:11:58.345070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b1f7-cd80-48a1-b492-a1ba3d97f44c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:58.345574 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b1f7-cd80-48a1-b492-a1ba3d97f44c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:58.345647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b1f7-cd80-48a1-b492-a1ba3d97f44c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:58.346935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 174/335] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:58.352764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2650-7b27-4e0f-9d78-d59f5405f6d6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:58.353210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2650-7b27-4e0f-9d78-d59f5405f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:58.353384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2650-7b27-4e0f-9d78-d59f5405f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:58.386144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ad5f2650-7b27-4e0f-9d78-d59f5405f6d6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:58.388158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad5f2650-7b27-4e0f-9d78-d59f5405f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:58.480432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 162/336] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:59.036455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b1f7-cd80-48a1-b492-a1ba3d97f44c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:59.084086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077f0f-8056-4a46-a0bd-e0f4e471e14b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.084405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077f0f-8056-4a46-a0bd-e0f4e471e14b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.084665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077f0f-8056-4a46-a0bd-e0f4e471e14b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.086012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 163/337] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:59.101422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6041-fc45-454f-bf73-3a45e78add14 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.101724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6041-fc45-454f-bf73-3a45e78add14 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.101981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6041-fc45-454f-bf73-3a45e78add14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.140673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-691c6041-fc45-454f-bf73-3a45e78add14 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:59.141883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-691c6041-fc45-454f-bf73-3a45e78add14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:59.192413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5b1f7-cd80-48a1-b492-a1ba3d97f44c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:59.249280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:59.251012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.252996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.256268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.257602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:59.277453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-eae2744d-51bc-4af8-accf-33b22bc88bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:11:59.283972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:11:59.284905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:11:59.285677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:11:59.291608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 164/338] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:11:59.295108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 175/339] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:11:59.296218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1723-ce4d-4e29-b815-34180150dbd7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.296730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1723-ce4d-4e29-b815-34180150dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.297198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1723-ce4d-4e29-b815-34180150dbd7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.298771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 165/340] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:59.304480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133344d5-4973-4b7d-a8bd-538dc4856a2a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.304788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133344d5-4973-4b7d-a8bd-538dc4856a2a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.305060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133344d5-4973-4b7d-a8bd-538dc4856a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.305554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1723-ce4d-4e29-b815-34180150dbd7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:59.345251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-133344d5-4973-4b7d-a8bd-538dc4856a2a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:59.349601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-133344d5-4973-4b7d-a8bd-538dc4856a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:59.373858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:59.503490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 176/341] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:59.504605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904704-a426-453f-a28f-0a02326d23e7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.504910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904704-a426-453f-a28f-0a02326d23e7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.505181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904704-a426-453f-a28f-0a02326d23e7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.506687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 177/342] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:11:59.513614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.513895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.514170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.547626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:11:59.549305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:11:59.550296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1723-ce4d-4e29-b815-34180150dbd7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:59.652504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:11:59.653141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:11:59.653476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:11:59.653752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:11:59.654463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:11:59.654762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:11:59.656137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:11:59.669790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 166/343] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:11:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:11:59.670621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:59.703093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 178/344] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:11:59.704221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:11:59.793192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:59.928130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872908e2-7c89-49d5-b941-2c15072fbecc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:11:59.939919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:59.992275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4b115-7d03-4900-960d-6bdbd177bb54 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.022947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.023732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.024017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.025072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.037506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.038542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.039038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.039348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.049763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:00.055541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:00.056397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:00.057366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 167/345] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:11:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:00.058613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.137495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:00.138970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:00.232124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.261730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec04fe6-213b-47c7-8286-69563b3f84f5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.266980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 179/346] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:00.268156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.287050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.341783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.342285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.342571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.342843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.369427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:00.375947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:00.376922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:00.377807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 168/347] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:00.383529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.386958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09896-e8b6-43f7-ad98-3d54ad0d9259 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.433879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.435391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.436162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.436940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.438400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:00.439050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:00.440738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:00.452125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 180/348] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:00.457519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.509702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.537497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee059-56d9-430f-aa2f-32e4ba181dc3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.600387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.600387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.600387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.600387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.607539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea48a7-0120-48bc-81ec-88e61637e1b4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.617966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:00.627470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:00.628391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:00.629209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:00.630296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 169/349] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:00.634800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.661610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.662621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.663232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.663932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.665472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:00.667061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:00.669674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 181/350] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:00.670668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.676827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.776450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bb1b-4756-4e4e-aeb9-63ef1e3a05bb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.818460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.819422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.820070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.820533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.821062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329445e-6bfc-4a1a-82fa-d73f26f7b622 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:00.821634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:00.821951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:00.823365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91957162-89d0-499f-8686-5b2ea2ecd173 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:00.824545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.834173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 170/351] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:00.835271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3c5b-71b7-48ef-8574-0b5336657b4c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.835562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3c5b-71b7-48ef-8574-0b5336657b4c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.836451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db3c5b-71b7-48ef-8574-0b5336657b4c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.838056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 171/352] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:00.838859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3c5b-71b7-48ef-8574-0b5336657b4c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.873224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:00.874209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:00.874711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:00.875193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] PATH_INFO: `/v3/users/a997c51845ef4e678739e025bbe8d25d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:00.876570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] RBAC: Authorizing `identity:get_user(user_id=a997c51845ef4e678739e025bbe8d25d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:00.878288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:00.880080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 182/353] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/users/a997c51845ef4e678739e025bbe8d25d => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:00.881245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:00.957120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:00.973166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db3c5b-71b7-48ef-8574-0b5336657b4c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.021154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cb34-4cae-4790-8c7b-cf8c469bb35d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.026347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.027970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.028225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.028507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.029343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:01.029653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.031115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.045092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 172/354] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:01.045860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.084083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.085119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.085410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.085825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.096355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.097886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9717-d948-4d8f-bf6c-efd2c9681f97 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.099999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 183/355] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:00 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:01.101746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.102010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.102280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.122814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:01.124171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:01.157239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.176538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd62dd-53e3-4d52-89e8-03605ec22108 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.203617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 184/356] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:01.204287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.223183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.224040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.224315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.224604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.255864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.318262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.320103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.346237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b245ca3-09a4-4386-9741-8b7fd84a3fcd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.393713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.394336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.394695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.394811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.395537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] RBAC: Adding query filter params (role.id=8668698ff2614b9783e8b57cb7a755c0, user.id=a997c51845ef4e678739e025bbe8d25d, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:01.395842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.397303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.410288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 185/357] 10.222.0.71 () {56 vars in 1308 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/role_assignments?user.id=a997c51845ef4e678739e025bbe8d25d&scope.system=all&role.id=8668698ff2614b9783e8b57cb7a755c0 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:01.411958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.455915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.458396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 173/358] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:01.459867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.552668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.569096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411798-128e-485b-99b8-69e049ddb52a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.617861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5d387-d8f5-45ee-afe0-d905d4edfa2e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.622324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.622936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.623211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.623551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.660922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.661526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.661801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.662068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.662786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=122667ff87e3416992a6a2c8507ca461) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:01.663094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.664530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25270acd-22c6-41ac-998c-5c8e0c9e5510 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.674039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 174/359] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:01.675585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a694d5-f3b0-4345-b32b-af8c20d06a63 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.676073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a694d5-f3b0-4345-b32b-af8c20d06a63 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.677007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a694d5-f3b0-4345-b32b-af8c20d06a63 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.678775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 175/360] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:01.679750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a694d5-f3b0-4345-b32b-af8c20d06a63 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.726747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.728232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbbd21-04cb-4d5c-a381-b6fcfba40dc5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.762713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.818544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a694d5-f3b0-4345-b32b-af8c20d06a63 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:01.839419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:01.866301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:01.866946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.867227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.867501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.869103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:01.870633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:01.872619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 176/361] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:01.873225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:01.887664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 186/362] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:01.889393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:01.889933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:01.890409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:01.910542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:01.911656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:01.995285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 187/363] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:02.000750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.006526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c6b-e7c0-45db-ab67-c9d55424daed None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.054500 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.055136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.055419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.055686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.068342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:02.074436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:02.075380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:02.076189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 177/364] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:02.076903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.082111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.130627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad7fa7-2f10-4e55-9932-58e605c9b67e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.131532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.174873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.176056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.176343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.176932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.178176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.179740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.181720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 188/365] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:01 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.182504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.208819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02833-d1d1-4e38-8b40-03dd8fcb26b3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.259430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.260078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.260360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.260659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.263041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.264518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.266206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 178/366] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.266970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.305094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3fa1-fad4-4cca-b1d0-f7fcaf85d1dd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.328257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.351191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.351893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.352168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.352433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.353139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:02.353602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.355756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.365442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 189/367] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.366090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.401267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b925-7ff0-45b9-bafd-c352d00473f1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.421399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.445116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.445743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.446000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.446270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.446994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=122667ff87e3416992a6a2c8507ca461) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:02.447299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.450012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.456130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 179/368] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.456863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.507540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c238890-1480-413a-8d26-dcb0973f6943 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.559018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.560189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.560753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.561551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.563712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.565707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.568517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 190/369] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.569570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.585817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84333d6-81e4-41f7-a8b3-03ebd64772e0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.637677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.639062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.639341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.639608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.657342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.664993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:02.670889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:02.671871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:02.672752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 180/370] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:02.673408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.732195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.741659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5882-bedc-4e86-a27c-cbe9ae060b2f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.789954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.790948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.791642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.792115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.799934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057859-c47d-42d4-a7ee-374ae55385dd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.849467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:02.851049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:02.851536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:02.852303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:02.853524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=db12b0cd5fef4105939a9f08138e2086) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:02.854005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.856182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.865294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 181/371] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:02.866388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:02.878874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:02.880673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:02.952032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:02.992333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3d898-8caf-4a0a-917c-f27c4390d218 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:02.995057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:03.027177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 191/372] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:03.033509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:03.043248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.043928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.044288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.044816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.045583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:03.045949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.047528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.060162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 182/373] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:03.065247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:03.205071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e7d0-354b-4c55-9fad-b195be13b3ba None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:03.239325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df6da-7ba7-4c2b-ac2b-21b90eb160c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:03.245343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.246168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.246544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.246916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.286776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.287598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.287873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.288143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.289883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.291481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.294373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 192/374] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:03.304844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:03.310419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:03.345545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:03.425396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.426590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355cc69-d67a-4c97-ab12-a29050c7c732 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:03.426870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.467028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.468013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.468435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.468896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.470313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.471880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.473965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 193/375] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:03.484339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:03.600992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:03.614719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1b85c-f354-4507-91b2-d0cb98b629d8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:03.655566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.656497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.656952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.657365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.658256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=db12b0cd5fef4105939a9f08138e2086) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:03.658880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.660590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.668841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 194/376] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:03.712622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 183/377] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:12:03.718877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:03.838864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf961f-db53-46c3-a47e-afff08dcc125 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:03.891871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:03.892801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:03.893469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:03.894127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] PATH_INFO: `/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:03.896056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd2e4c4b06fe4e64af36c6417cd1e022)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:03.898172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:03.900387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 195/378] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:03.906043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:04.002922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:04.045248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baeb92-d418-4da0-b562-5e01a77b199e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:04.084069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:04.084969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:04.085386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:04.085794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] PATH_INFO: `/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:04.092828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] RBAC: Authorizing `identity:get_group(group_id=15871ac1f27a4681a7e17bdb00b9f0ce)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:04.094485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dcab2-0108-4356-9dcd-2ab07d1d6222 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:04.096288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 184/379] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:03 2022] GET /identity/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:04.102902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:04.125083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:04.214780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f1f8-9578-495c-af5b-f9181dac95d8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:04.255376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:04.256209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:04.256641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:04.257040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:04.258202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] RBAC: Adding query filter params (group.id=15871ac1f27a4681a7e17bdb00b9f0ce, role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=cd2e4c4b06fe4e64af36c6417cd1e022) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:04.258660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:04.262034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611a54a-ea57-4aab-b1bd-ea6569eedc1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:04.270586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 196/380] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:04 2022] GET /identity/v3/role_assignments?group.id=15871ac1f27a4681a7e17bdb00b9f0ce&scope.project.id=cd2e4c4b06fe4e64af36c6417cd1e022&role.id=831a0d01705f489683bef40d08847bc6 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:04.401574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbacc7-66dc-4a7a-ae59-c26d464f0993 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:04.401901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbacc7-66dc-4a7a-ae59-c26d464f0993 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:04.402644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbacc7-66dc-4a7a-ae59-c26d464f0993 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:04.403617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 185/381] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:04.409025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:04.409303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:04.409572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:04.431872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:04.433887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:04.508867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 197/382] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:04.914498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbacc7-66dc-4a7a-ae59-c26d464f0993 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.051747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbacc7-66dc-4a7a-ae59-c26d464f0993 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:05.094232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:05.106856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:05.107507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.107789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.108066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.125499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-692cdf6d-e71d-4073-a8b7-fb3bbf2185aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:05.137188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:05.138100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:05.138909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:05.139518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 186/383] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:05.145340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.169008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:05.206117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b6cd-c477-49ae-9f4f-7ef9d9d754ae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.206701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b6cd-c477-49ae-9f4f-7ef9d9d754ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.206983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7b6cd-c477-49ae-9f4f-7ef9d9d754ae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.209798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 187/384] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:05.221972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.222256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.222529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.267351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63050e67-9650-4361-bb9d-b3ab75162062 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:05.269556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:05.270762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:05.303083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:05.303689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.303982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.304256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.305021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:05.305330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:05.306751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:05.315613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 198/385] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:05.321114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.418877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 188/386] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:05.481045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:05.493663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14a1db-e736-4d29-8087-d9a7e24738ca None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:05.550578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:05.551232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.551506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.551774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.552993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:05.554442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0df6b-374f-440f-8968-87177618f3d5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:05.556218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 199/387] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:05 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:05.561950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.684887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb862f-e570-417c-9cc7-cbff12309691 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.685214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb862f-e570-417c-9cc7-cbff12309691 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.685445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb862f-e570-417c-9cc7-cbff12309691 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.687090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 200/388] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:05.692550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.693082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.693555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.707607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02807a-ca41-4863-89a2-4fa6b0c67fc3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:05.728971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:05.729563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:05.731764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:05.750684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:05.751325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:05.751606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:05.751882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:05.753045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:05.754988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:05.756949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 189/389] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:05 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:05.763658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.889431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 201/390] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:05.909649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:05.951223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682570b1-02e9-4313-9d7e-c0fb161ca3db None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.018805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.019384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.019665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.019938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.022370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, group_id=2a35184388cb495688fdfe5fa3ccd0fc, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:06.023803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:06.038330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:06.050431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 190/391] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Sep 19 11:12:05 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:12:06.084944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46f0ca-c4de-4928-b3cd-f8d7d27b6704 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.150445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.151307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.151434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.152290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.168030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:06.173276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:06.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:06.175362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 202/392] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:06.182579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.182777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.265819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:06.348438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2447-09d6-47df-b976-8811566a59a2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.378722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df148695-ae00-426b-a338-4a6181c9efa2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.423320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.423935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.424214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.424486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.425187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:06.425487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:06.426875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:06.437709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:06.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 191/393] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:06.447950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.452720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.453360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.453637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.453906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.475495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:06.481275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:06.482162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:06.483373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 203/394] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:06.490790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.670783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fddd2-596d-44af-8273-26a50ab785e2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.679581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:06.692989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ba5d5-6129-4160-90e3-d60e464569a7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.713782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.714834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.715114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.715386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.716524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:06.718674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dd36f-0493-4f3e-8fb3-4baf33946cee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:06.721309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 192/395] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:06.725918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c874-4beb-43f5-9026-118e3bbb581d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.726204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c874-4beb-43f5-9026-118e3bbb581d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.726479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c874-4beb-43f5-9026-118e3bbb581d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.727870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 193/396] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:06.728447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c874-4beb-43f5-9026-118e3bbb581d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.743799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.744367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.744716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.744993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.746189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:06.746494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:06.747879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308833d-63d1-4fd1-b68a-99332341ff1a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:06.770758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 204/397] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:06.772051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.772340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.772673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.791571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:06.793502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:06.864920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:06.865113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c874-4beb-43f5-9026-118e3bbb581d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:06.891466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 205/398] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:06.892853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:06.924808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:06.925457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:06.925636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:06.925916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:06.927127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:06.928889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:06.937106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 194/399] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:06.944151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.007404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:07.021976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7555d0-665a-4a7f-aa5e-7acd65d49e2d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.057058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.057685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.058042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.058324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.059678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.061155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e0928-e57c-4d55-860d-965b0368d733 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.062871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 206/400] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:06 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:07.063825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdb11-6cd9-49b9-b06f-ae8a02b202cb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.064095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdb11-6cd9-49b9-b06f-ae8a02b202cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.064371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdb11-6cd9-49b9-b06f-ae8a02b202cb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.070429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 207/401] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:07.071119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cdb11-6cd9-49b9-b06f-ae8a02b202cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.081523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719f029-7ed2-4465-9ea9-91e55499654f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.129226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.130334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.130815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.131396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.133044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:07.136859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=122667ff87e3416992a6a2c8507ca461, group_id=2a35184388cb495688fdfe5fa3ccd0fc, role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.140300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e8843-188b-4353-9d8b-8f775e2031f2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.174737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 195/402] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Sep 19 11:12:06 2022] PUT /identity/v3/projects/122667ff87e3416992a6a2c8507ca461/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/6c5ab00012a74672bf6dcbc47131673e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:07.174737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.174737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.174737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.199932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:07.205140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:07.245031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cdb11-6cd9-49b9-b06f-ae8a02b202cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.293101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 196/403] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:07.294492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.308831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.309619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.309897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.310216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.312244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.313796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.315976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 208/404] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:07.325106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.358658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:07.444063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f143d4e-b54f-4cdf-96d1-99fd0b8d5774 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.474039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2eb5-04ae-4ce5-8df9-7673414ed77e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.504393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:07.505903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.506597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.506872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.507142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.521050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.521709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.521986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.522249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.524181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, group_id=2a35184388cb495688fdfe5fa3ccd0fc, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.525754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.531759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:07.536885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:07.537892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:07.538677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 197/405] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:07.544778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.562485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 209/406] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Sep 19 11:12:07 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:07.701487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:07.711287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514e89-9cff-486f-8fec-42d7e00003bf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.765388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.765919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.766192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.766458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.767127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:07.767423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.768847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.778242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 198/407] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:07.784049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.784198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:07.920606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896430b-0d29-4ab7-b182-a8f2f12e13cb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.930123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ade9-497f-4126-a66d-38b2949ca1ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:07.975566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:07.976200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:07.976473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:07.978449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:07.981306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:07.984548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:07.988799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 199/408] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:07.994746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.003619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.006731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.007010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.007279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.032778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:08.041735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:08.042670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:08.043464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:08.044521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 210/409] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:08.047251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:08.050988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.107395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:08.162874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6414-52c0-48aa-b194-8c955ebc0b53 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.200638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.200858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.201239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.201658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.202445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:08.202868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.204365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.216403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 211/410] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:08.226218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.253910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de533f8-2b34-4044-be5b-0096766f5d19 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.320847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.321488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.321859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.322136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.323277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.327404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.329312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 200/411] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:07 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:08.336251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.412702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7116-d08a-4ca6-ad58-70026f52ed35 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.421446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:08.486197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.486831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.487105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.487373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] PATH_INFO: `/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.489148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] RBAC: Authorizing `identity:get_group(group_id=15871ac1f27a4681a7e17bdb00b9f0ce)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.490582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.499274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 212/412] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:08 2022] GET /identity/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:08.503756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.520156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:08.535709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03afa-2cd1-459b-bc1e-9ef977ecbb96 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.595955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.596603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.597349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.597666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.600834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] RBAC: Authorizing `identity:create_grant(project_id=db12b0cd5fef4105939a9f08138e2086, group_id=2a35184388cb495688fdfe5fa3ccd0fc, role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.602547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2113d-8787-4f60-9178-ea9fe1111401 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.621052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 201/413] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Sep 19 11:12:08 2022] PUT /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086/groups/2a35184388cb495688fdfe5fa3ccd0fc/roles/6c5ab00012a74672bf6dcbc47131673e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:12:08.622521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410ba7-661e-4e18-afb3-eafe86dd7bef None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.622847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410ba7-661e-4e18-afb3-eafe86dd7bef None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.623131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410ba7-661e-4e18-afb3-eafe86dd7bef None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.630075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 202/414] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:08.631844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.632135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.632470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.655641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:08.656910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:08.710672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe427edb-4200-4b29-9d02-54670f9e6c7c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.744347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 203/415] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:08.810316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.810959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.811233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.811505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] PATH_INFO: `/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.812750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd2e4c4b06fe4e64af36c6417cd1e022)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.814209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.816140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 213/416] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:08 2022] GET /identity/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022 => generated 344 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:08.822080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:08.909784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:08.929236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446648-eb0e-4629-813f-3c491556ba5e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:08.966987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:08.967715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:08.968045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:08.968326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] PATH_INFO: `/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022/groups/15871ac1f27a4681a7e17bdb00b9f0ce/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:08.970240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2e4c4b06fe4e64af36c6417cd1e022, group_id=15871ac1f27a4681a7e17bdb00b9f0ce, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:08.971690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:08.995794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 204/417] 10.222.0.71 () {58 vars in 1442 bytes} [Mon Sep 19 11:12:08 2022] PUT /identity/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022/groups/15871ac1f27a4681a7e17bdb00b9f0ce/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:12:09.064340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:09.108838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:09.179231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb5d3-ed34-4375-abce-ee7a94d49ef6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:09.239282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:09.239983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:09.240269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:09.240544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:09.255288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:09.260677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:09.263637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:09.265591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 214/418] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:09.272603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:09.398261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d6346-26bb-47ba-9083-5985b25dc3cf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:09.439256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:09.440152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:09.440653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:09.441177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:09.441753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:09.442107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:09.443495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:09.453024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 205/419] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:09.458857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:09.605632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:09.610365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f79fd4-3e20-4dc2-87eb-62f0949eb369 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:09.663175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:09.663786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:09.664069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:09.664344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:09.752127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:09.757734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538f980-5ac7-47f0-bbdb-f7a050998c50 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:09.862622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:09.871957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 215/420] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:09.879626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:09.894877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:09.994144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a78e0-0fe8-4c9c-903f-a6adc2035480 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:09.994766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a78e0-0fe8-4c9c-903f-a6adc2035480 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:09.995264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a78e0-0fe8-4c9c-903f-a6adc2035480 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:09.997070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 216/421] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:10.006117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d3a8-9925-4450-8b57-209929f21ab2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.006982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d3a8-9925-4450-8b57-209929f21ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.007594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6d3a8-9925-4450-8b57-209929f21ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.057506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e950a8-5b3e-4d11-be8e-381a2d276eaa None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:10.069784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c2e6d3a8-9925-4450-8b57-209929f21ab2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:10.074352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c2e6d3a8-9925-4450-8b57-209929f21ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:10.096764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:10.097658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.098101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.098512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.100212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:10.101987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:10.104097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 206/422] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:09 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:10.110675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:10.225538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 217/423] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:10.248975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:10.255571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481de78-0a6e-48be-8950-ec57e5f10b94 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.256059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481de78-0a6e-48be-8950-ec57e5f10b94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.256559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481de78-0a6e-48be-8950-ec57e5f10b94 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.258359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 218/424] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:10.263815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.264384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.264877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.273908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e3f8-0f0d-4668-b737-1a1b0b9f4874 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:10.294944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:10.297961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:10.345451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:10.346515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.347954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.349973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.351382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:10.353830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:10.357064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 207/425] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:10 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:10.363797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:10.455650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 219/426] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:12:10.526978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:10.538778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660a521-1d50-4797-8261-a996b9531dd6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:10.648619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:10.648975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.649147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.649745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.651816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=122667ff87e3416992a6a2c8507ca461) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:10.653117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:10.654731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:10.672869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:10.675234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 208/427] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:10 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 611 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:10.765750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:10.770606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:10.778823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ecc8b-f2da-404b-a3ef-860e3e4c18e5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:10.826914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000795-f040-4365-8047-408a07483d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:10.828924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000795-f040-4365-8047-408a07483d58 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:10.829569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000795-f040-4365-8047-408a07483d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:10.830616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000795-f040-4365-8047-408a07483d58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:10.855405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000795-f040-4365-8047-408a07483d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d0000795-f040-4365-8047-408a07483d58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:10.861015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:10.862192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:10.863206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:10.870065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 220/428] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:10.878653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000795-f040-4365-8047-408a07483d58 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:10.954387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d22c-4bdd-43f3-8287-eb1ee443ea20 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.005589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.006224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.006506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.006779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.018256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000795-f040-4365-8047-408a07483d58 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.022030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:11.029264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:11.030132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:11.030935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 209/429] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:11.035893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.049068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.081250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.082354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.082922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.083387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.084712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:11.085461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.087277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.099994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 221/430] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:11.106225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.129900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.181901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ba3a0-0255-4c10-bf88-177aea7a972e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.232714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.233408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.233697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.234067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.234698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] RBAC: Adding query filter params (name=member) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:11.235053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.236523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.246261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 210/431] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:11.251885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.254422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59441b88-9467-4b3a-832d-35b3244d09ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.309895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.310512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.310797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.311072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.369754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.392165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fdbaa-b6de-4bfe-9e58-49f68ac74938 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.395878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.397588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.424375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.434843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.435456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.435737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.436011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.510180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 222/432] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:12:11.518298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.519302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.519787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.617278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.630733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 211/433] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:11.636369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.649855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199b0c-8be3-48d5-8275-18f7b6a426a1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.668004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.693210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.694189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.694603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.695007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] PATH_INFO: `/v3/projects/122667ff87e3416992a6a2c8507ca461` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.697784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] RBAC: Authorizing `identity:get_project(project_id=122667ff87e3416992a6a2c8507ca461)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.699763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855ec0d-8603-41d9-aeda-653f5ca53a73 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.701916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 223/434] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/projects/122667ff87e3416992a6a2c8507ca461 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:11.703292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f30d3-150f-45d2-9440-d596682627be None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.703849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f30d3-150f-45d2-9440-d596682627be None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.704288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f30d3-150f-45d2-9440-d596682627be None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.706278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 224/435] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:11.707592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f30d3-150f-45d2-9440-d596682627be None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.754061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31978687-a8ea-46dc-8796-58eff658c00c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.793253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.794643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.794944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.795214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.796341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.797819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22555d8-e251-4654-b948-cf6b3d1dd5a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.800004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 212/436] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:11.801776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3d25-919c-466e-a57f-2b95a150a6b8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.802061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3d25-919c-466e-a57f-2b95a150a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.802332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd3d25-919c-466e-a57f-2b95a150a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.821469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-36bd3d25-919c-466e-a57f-2b95a150a6b8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:11.822663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-36bd3d25-919c-466e-a57f-2b95a150a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:11.832080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f30d3-150f-45d2-9440-d596682627be None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:11.868947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:11.869475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.869751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.870019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.871167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:11.872601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:11.874202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 225/437] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:11.874945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.890907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 213/438] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:11.892155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87fbb1-4023-47ff-83d1-52618a677d57 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:11.892444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87fbb1-4023-47ff-83d1-52618a677d57 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:11.892758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87fbb1-4023-47ff-83d1-52618a677d57 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:11.896759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 214/439] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:11.896759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87fbb1-4023-47ff-83d1-52618a677d57 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:11.897334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.932180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:11.981423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c364-cf5b-4aa7-879a-b00e980110aa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.014828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87fbb1-4023-47ff-83d1-52618a677d57 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.016183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.016846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.017122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.017391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.018508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.019925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c06aa-0527-494d-991d-3ef758a0a8e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.021504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 226/440] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:12.022584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.022857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.023123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.041036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:12.042782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:12.056244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.057248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.057734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.058182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.059082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=122667ff87e3416992a6a2c8507ca461) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:12.059634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.061392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.068135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 215/441] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:11 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=122667ff87e3416992a6a2c8507ca461&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:12.068952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.135454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 227/442] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:12.164021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.184440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.190488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.216134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088f330-8abb-4fa9-880c-635c680da9db None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.253836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.254575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.254856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.255127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.256241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=fab8c6e936c1459c88d7b63932c49458, scope.project.id=db12b0cd5fef4105939a9f08138e2086) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:12.256555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.258367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.268479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 216/443] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=fab8c6e936c1459c88d7b63932c49458 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:12.304340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede132f4-55fa-4a85-98f5-ca6fad832c57 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.354496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.355197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.355472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.355740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.368177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:12.373793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:12.374746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:12.375529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 228/444] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:12.380954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.428117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.516138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047119e9-6998-416b-b4a9-e4b733548b4e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.527538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.558871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.559340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.559629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.559905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.561090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:12.561524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.562914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.563089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85557da-cdaa-447f-8379-a7125efb8df2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.572331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 217/445] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:12.578400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.598088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.602799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.603430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.603708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.603976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.615931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:12.621609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:12.623057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:12.624030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 229/446] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:12.628417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.703166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748e15-901c-4b77-ba4c-e56066e39e55 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.741203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.741810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.742085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.742353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.750172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc512c-bfdd-48fc-8f81-600218d8152d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.783954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.784545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.784862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.785131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.785793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:12.786090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.787454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.788803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.797373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 230/447] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:12.803042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.812802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:12.814258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:12.829011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:12.901113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ad78-ef18-4926-b33f-3578fe59dff2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:12.912270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 218/448] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:12:12.918857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:12.934791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:12.935389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:12.935668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:12.935943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:12.995970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:13.002964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.004410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.016161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621a9-36bf-444b-802e-c7fef2a4eeac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.030201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:13.050508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.051125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.051400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.051667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] PATH_INFO: `/v3/projects/db12b0cd5fef4105939a9f08138e2086` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.052795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] RBAC: Authorizing `identity:get_project(project_id=db12b0cd5fef4105939a9f08138e2086)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.054235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.055827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 219/449] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/projects/db12b0cd5fef4105939a9f08138e2086 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:13.061901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:13.102088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 231/450] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:12:13.108142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:13.157904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ce23e-9beb-4643-a1ed-9e4277350ddf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.192292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.192951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.193238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.193507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] PATH_INFO: `/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.194735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] RBAC: Authorizing `identity:get_group(group_id=2a35184388cb495688fdfe5fa3ccd0fc)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.196233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.197865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 220/451] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:13 2022] GET /identity/v3/groups/2a35184388cb495688fdfe5fa3ccd0fc => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:13.197984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:13.203971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:13.211710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b32-0a1b-43c5-8fb2-6d1fc0f752e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.245861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.246864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.247062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.247326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] PATH_INFO: `/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.248498 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] RBAC: Authorizing `identity:get_project(project_id=cd2e4c4b06fe4e64af36c6417cd1e022)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.249962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.251559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 232/452] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:12:13 2022] GET /identity/v3/projects/cd2e4c4b06fe4e64af36c6417cd1e022 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:13.258307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:13.259225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:13.310355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2c5d-0dca-49df-a5c9-cfa20fb115ab None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.344491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.345117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.345399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.345672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.346396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] RBAC: Adding query filter params (group.id=2a35184388cb495688fdfe5fa3ccd0fc, role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=db12b0cd5fef4105939a9f08138e2086) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:13.346707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.348190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.354181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 221/453] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:13 2022] GET /identity/v3/role_assignments?group.id=2a35184388cb495688fdfe5fa3ccd0fc&scope.project.id=db12b0cd5fef4105939a9f08138e2086&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:13.356526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0f74-afbb-4aae-8862-05bdc559509d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.394819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.395451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.395728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.396002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] PATH_INFO: `/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.397184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] RBAC: Authorizing `identity:get_group(group_id=15871ac1f27a4681a7e17bdb00b9f0ce)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.398635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7795d3-640d-4789-a633-2169442562d0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.400233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 233/454] 10.222.0.71 () {56 vars in 1180 bytes} [Mon Sep 19 11:12:13 2022] GET /identity/v3/groups/15871ac1f27a4681a7e17bdb00b9f0ce => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:13.406466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:13.514485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572eed-9fcd-4975-8dd0-51d9fa7a3144 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:13.528495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:13.551380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:13.551977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:13.552252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:13.552523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:13.553284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] RBAC: Adding query filter params (group.id=15871ac1f27a4681a7e17bdb00b9f0ce, role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=cd2e4c4b06fe4e64af36c6417cd1e022) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:13.553591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:13.555007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37f34-1418-4a6c-b12e-8488582310e6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:13.561463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 222/455] 10.222.0.71 () {56 vars in 1376 bytes} [Mon Sep 19 11:12:13 2022] GET /identity/v3/role_assignments?group.id=15871ac1f27a4681a7e17bdb00b9f0ce&scope.project.id=cd2e4c4b06fe4e64af36c6417cd1e022&role.id=831a0d01705f489683bef40d08847bc6 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:16.153953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b58c-f7e2-410c-8b57-4dea1f495317 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.154506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b58c-f7e2-410c-8b57-4dea1f495317 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.154506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04b58c-f7e2-410c-8b57-4dea1f495317 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.156074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 234/456] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:16.161259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f9b9-ffa4-4d17-861d-cceab9c76814 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.161652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f9b9-ffa4-4d17-861d-cceab9c76814 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.161831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f9b9-ffa4-4d17-861d-cceab9c76814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.187094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2314f9b9-ffa4-4d17-861d-cceab9c76814 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:16.188275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2314f9b9-ffa4-4d17-861d-cceab9c76814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:16.285505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 223/457] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:16.460370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80720d8-f88f-4f7b-ac66-1be80279386f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.460554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80720d8-f88f-4f7b-ac66-1be80279386f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.460821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80720d8-f88f-4f7b-ac66-1be80279386f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.462409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 235/458] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:16.468213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f52b-a55d-4140-84e6-767d17102d97 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.468498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f52b-a55d-4140-84e6-767d17102d97 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.468796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f52b-a55d-4140-84e6-767d17102d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.505468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2486f52b-a55d-4140-84e6-767d17102d97 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:16.506647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2486f52b-a55d-4140-84e6-767d17102d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:16.595569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 224/459] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:12:16.642960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80720d8-f88f-4f7b-ac66-1be80279386f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:16.645750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402de8-2295-4ca4-9a45-4839a021a802 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.646036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402de8-2295-4ca4-9a45-4839a021a802 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.646308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20402de8-2295-4ca4-9a45-4839a021a802 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.647899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 225/460] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:16.655632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.655912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.656190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.687770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:16.690108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:16.706079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:16.754743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:16.825700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 226/461] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:16.839003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80720d8-f88f-4f7b-ac66-1be80279386f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:16.876557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:16.877209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:16.877483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:16.877749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:16.888199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:16.889686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:16.909904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:16.910808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:16.911668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:16.911668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:16.911668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:16.911668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 236/462] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:16.918517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.002085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.062769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32634b-d7b8-4398-9ec5-b88e7b7d5a74 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.129458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.130070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.130450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.130727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.131435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:17.131742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.133191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.140404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.148846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 227/463] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:17.149843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.164353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c964d-1275-42f0-9d8a-b1821dd64778 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.187292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.212914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.213651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.215371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.215371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.226658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.228483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:17.247753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:17.248738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:17.249604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:17.249604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:17.249604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:17.252064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 237/464] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:17.253404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.286084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7aaf8-15a6-4c4a-853f-75ce791f8532 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.332081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.332643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.332925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.333195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.345103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.347015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:17.362880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:17.363806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:17.369503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:17.369503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:17.369503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:17.369503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 228/465] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:17.369503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.383795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c18b6e-2091-486c-b95a-e54c098cd923 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.420845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.421444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.421746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.421997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.422640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.424060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc491d-6dc2-4935-9de7-603f0273ad5b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.434575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.447144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 238/466] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:17 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:17.454281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b7abd-8e3d-4403-88a0-86c18b53e915 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.454998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b7abd-8e3d-4403-88a0-86c18b53e915 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.455469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b7abd-8e3d-4403-88a0-86c18b53e915 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.457817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 239/467] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:17.459163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.460896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b7abd-8e3d-4403-88a0-86c18b53e915 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.484351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6746-cd3a-4f37-bbb4-d2ee8af9ff1c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.534227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.535578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.536292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.536862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.537890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:17.538412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.540437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade042e-5270-48b0-a37a-00ee0d21dd1a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.557029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 229/468] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:17.560176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637e7e-7ee1-44c9-9bfd-d24ab6eda587 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.560763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637e7e-7ee1-44c9-9bfd-d24ab6eda587 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.561360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6637e7e-7ee1-44c9-9bfd-d24ab6eda587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.582764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a6637e7e-7ee1-44c9-9bfd-d24ab6eda587 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:17.584327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6637e7e-7ee1-44c9-9bfd-d24ab6eda587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:17.604435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b7abd-8e3d-4403-88a0-86c18b53e915 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.648257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.649188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.649472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.649748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.650401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:17.650704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.653743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.669870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 240/469] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:17.670046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.672966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 230/470] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:17.674285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a41ed-cd29-40be-a35a-0f4b6d2ed8ec None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.674620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a41ed-cd29-40be-a35a-0f4b6d2ed8ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.674897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a41ed-cd29-40be-a35a-0f4b6d2ed8ec None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.676163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 231/471] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:17.678354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a41ed-cd29-40be-a35a-0f4b6d2ed8ec None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.737307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.767831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:17.794446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955864c5-3f31-4c84-b290-5731e7e43578 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.816999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a41ed-cd29-40be-a35a-0f4b6d2ed8ec None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:17.834178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.834701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.835058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.835230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.835879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.837378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9096c-d7a8-49a5-8541-b0a513a76215 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.861921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 241/472] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:17 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:17.863342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.863628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.863900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.883686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:17.884722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:17.884829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:17.885336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:17.886361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:17.886804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:17.887629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:17.897349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:17.960802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 232/473] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:17 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:12:17.962058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:17.969384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 242/474] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:18.131563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cf12-a850-4c72-987f-d71521b2d007 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.163648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:18.175936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.176610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.176944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.177217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.191805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:18.193390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:18.221476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:18.222452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:18.223307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:18.223307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:18.223307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.223307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 233/475] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:18.229133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:18.272757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:18.283846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:18.364967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd35fca-e320-40ed-aaa0-6b302aa6bb8d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.405054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.405745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.406030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.406332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.407073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:18.407383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:18.408791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:18.409963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcad8a1-f4d8-4df1-88b8-eb21dd51afe1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.431934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 243/476] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:18.433996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:18.463542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.464728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.465016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.465396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.466073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:18.467588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:18.477595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:12:18.477595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:12:18.477595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [parameters: {'id': '20517013c114442d8b87750711db8737', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:12:18.477595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 19 11:12:18.497526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:12:18.498407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:12:18.499269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:12:18.500095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:12:18.501029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:12:18.501849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'id': '20517013c114442d8b87750711db8737', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:18.502596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:12:18.503355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.504175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 234/477] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Sep 19 11:12:18 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:18.513589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:18.549828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:18.554231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c37d9-279a-4c9c-8f42-21b423404454 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.591400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.592372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.592868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.593356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.594186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:18.595798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:18.608681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:18.634700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 244/478] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:18 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:18.703292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6442590-f4bb-486e-bb4f-b28031341718 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.740136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.740809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.741091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.741368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.754194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e56749d3-b7c9-419c-b465-a29a873122ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:18.759897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:18.761488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:18.762400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 235/479] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:12:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:18.769612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:18.897123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1ccc7-e0fd-4015-914d-afa7661ee99a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:18.942246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:18.942851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:18.943131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:18.943407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:18.944078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:18.944382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:18.945771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bde7e-bd85-41a2-9f73-4ed5057d111a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:18.956404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 245/480] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:19.991434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884aa7-b28a-47a4-99a3-81b3e0d5e15d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:19.992174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884aa7-b28a-47a4-99a3-81b3e0d5e15d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:19.992174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884aa7-b28a-47a4-99a3-81b3e0d5e15d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:19.993688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 236/481] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:20.006058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:20.006619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:20.006619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:20.037552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:20.038755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:20.050991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:20.133913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 246/482] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:20.590889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884aa7-b28a-47a4-99a3-81b3e0d5e15d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:20.729330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884aa7-b28a-47a4-99a3-81b3e0d5e15d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:20.730889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:20.782613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:20.783286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:20.783563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:20.783833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:20.800141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-eab63b1a-cf61-4faa-9976-593c79b54fe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:20.804991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:20.805849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:20.806629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 237/483] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:20.812380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:20.882711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c4be2-9110-4d8d-be6a-e12d3f8dd8ad None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:20.883005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c4be2-9110-4d8d-be6a-e12d3f8dd8ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:20.883173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c4be2-9110-4d8d-be6a-e12d3f8dd8ad None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:20.884742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 238/484] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:20.893810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f3ec3-4f4c-45f0-bd5b-2d1c4021bd41 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:20.894336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f3ec3-4f4c-45f0-bd5b-2d1c4021bd41 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:20.894798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f3ec3-4f4c-45f0-bd5b-2d1c4021bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:20.933449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aa3f3ec3-4f4c-45f0-bd5b-2d1c4021bd41 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:20.935014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa3f3ec3-4f4c-45f0-bd5b-2d1c4021bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:20.947552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d0d2-ba46-4e2c-adab-78962b2894d4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:20.988018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:20.988647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:20.988933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:20.989206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:20.990352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:20.990659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:20.992458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4c612-742d-4088-b930-97f7c5b0d849 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:21.002721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 247/485] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:21.004130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703143-7d5e-4921-9e27-de7e0a50fd1f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.004625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703143-7d5e-4921-9e27-de7e0a50fd1f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.005040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703143-7d5e-4921-9e27-de7e0a50fd1f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.006405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 248/486] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:21.008731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79703143-7d5e-4921-9e27-de7e0a50fd1f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.022015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:21.030124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 239/487] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:21.031877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.032307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.032761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.065579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:21.067041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:21.133407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79703143-7d5e-4921-9e27-de7e0a50fd1f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.170560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.171434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.171858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.172296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.185105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:21.186824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:21.202761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:21.203941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:21.205020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:21.205020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:21.205020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:21.206795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 249/488] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:21.213177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.226428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 240/489] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:21.276876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:21.319698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740fec-ebd0-4bdf-866a-c5d73dbe842b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.363059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.364162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.364717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.365220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.366114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:21.366423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:21.367874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:21.381005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 250/490] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:21.389990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.442198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:21.504929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.575779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e04f-08be-465d-a26a-9a980e0d3cf2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.631651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.632526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.633018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.633436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.641989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:21.643694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-544900d6-3e7a-466f-904c-0710035ae269 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:21.658941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:21.659986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:21.661202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:21.661825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5e43-7b6a-4ad4-a20a-27472bf443f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.663236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 241/491] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:21.664852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e7c-9345-4045-b2ac-fc5ad4e2b842 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.670155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e7c-9345-4045-b2ac-fc5ad4e2b842 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.670447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3e7c-9345-4045-b2ac-fc5ad4e2b842 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.676028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 242/492] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:21.676028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e7c-9345-4045-b2ac-fc5ad4e2b842 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.690505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:21.708206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.708871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.709144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.709649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.721922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:21.726995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:21.727856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 251/493] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:21.729264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.771758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:21.791340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3e7c-9345-4045-b2ac-fc5ad4e2b842 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.826183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.826801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.827076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.827343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.837548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:21.837987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab4744-3764-4c0a-8af7-e9007f882805 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b8b8e60c-d77c-4615-b6f3-27093916eb07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:21.843043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:21.843950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:21.845125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 243/494] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:21.845774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac061f-dbfc-490f-914e-1383193e081c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.845774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac061f-dbfc-490f-914e-1383193e081c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.845774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac061f-dbfc-490f-914e-1383193e081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.862991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e1ac061f-dbfc-490f-914e-1383193e081c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:21.864170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e1ac061f-dbfc-490f-914e-1383193e081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:21.874655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:21.875245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.875519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.875796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.876505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:21.876835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:21.878253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:21.913811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 252/495] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:21.914557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.933365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 244/496] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:21.945195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b04c-f5e5-4b28-b223-8bd8a9ae14f3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:21.945195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b04c-f5e5-4b28-b223-8bd8a9ae14f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:21.945195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b04c-f5e5-4b28-b223-8bd8a9ae14f3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:21.945195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 245/497] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:21.945195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b04c-f5e5-4b28-b223-8bd8a9ae14f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:21.957743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.027199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.044201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d43c-65ad-407c-a041-dbe66f87e5a7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.067110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171b04c-f5e5-4b28-b223-8bd8a9ae14f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.080699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.081497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.081777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.082045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.082877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:22.083558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.084962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.094016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 253/498] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:22.098641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.109063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.109774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.110003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.110328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.111000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:22.111300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.112862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b7597-855b-4d6c-9f06-6b4e2cfbca1b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.125540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 246/499] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:22.125540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.125540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.125540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.141608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:22.142803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:22.204515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.208323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec816b-3d89-4e18-af00-68ec11c23710 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.218580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 247/500] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:22.219429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.250263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.250858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.251143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.251413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.287234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.327057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.328869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.335987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a587f-68b8-4e22-9630-860ee285a9bb None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.370702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.371317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.371600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.371874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.381842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.383296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:22.398840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:22.399978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:22.400998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:22.400998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.400998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:22.405114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 248/501] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:22.405963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.433350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.438756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 254/502] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:22.440197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.513725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc76c-63f2-4282-babd-ff9d21b477ef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.529567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.543581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32219eca-41ad-4fa5-a1ac-01e4ee2db8fe None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.547826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.548514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.548840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.549111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.559366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.560868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:22.575264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:22.576343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:22.577457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:22.577457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.577457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:22.577457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 249/503] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:22.577679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.577770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.577847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.577847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.577847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.591319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.592807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:22.607328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:22.608296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:22.609610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:22.609610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.609610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:22.609610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 255/504] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:22.609610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.661711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.680276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69172a-8030-4ad0-ba72-be3fc322f1da None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.708731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a202-4a98-4f45-b4a0-631e2f5304c8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.713532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.714221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.714576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.714849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.715489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:22.715790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.717199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.728900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 250/505] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:22.730061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.741998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.742615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.742891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.743162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.754019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.755456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.759235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:22.769543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:22.770467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:22.771294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:22.771294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:22.771294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:22.771294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 256/506] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:22.771294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.834159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b5d09-fb6b-4184-85df-8c41e12359fe None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.868827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.869447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.869724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.869995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.872098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edefc9-3a8c-4072-add8-6dce8118ea31 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:22.874334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.880182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:22.885008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:22.886581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 251/507] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:22.887439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.909810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:22.910474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:22.910760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:22.911035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:22.911680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:22.911979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:22.913385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:22.925001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 257/508] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:22.925641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:22.974247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:22.986612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4aec4-efce-44f9-a487-7e3d4e28e797 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.020653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.021192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.021470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.021740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.022126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0ce4-874e-4c17-9b7a-90f29bd0fde0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.022378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.022679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.024061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.035441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 252/509] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.036228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.055578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.056199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.056469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.056765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.064442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.065956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:23.078981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:23.079980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 258/510] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:23.080888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.105019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.141785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c391-96de-4f70-87d8-4f7dd10001b3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.175520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.176117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.176392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.176689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.176854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55949100-0ae2-4637-bbca-05a50e7f0355 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.177321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.177619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.178972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.190885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 253/511] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.191664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.202603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.213072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.213668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.214550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.214818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.215475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.215773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.217156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.225279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 259/512] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.226136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.299118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa7b3-cbda-4aea-a1cb-36694e1d1e2b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.309928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.326591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3694-df04-40c1-82bc-169b81a3be0c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.332498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.333147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.333424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.333702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.341200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.342637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:23.354929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:23.356528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 254/513] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:23.358475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.367061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.368682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.368960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.370058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.370058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.371623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.397163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 260/514] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:23 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:23.397989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.441838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.484550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043117d-bfe6-4822-9707-b99c2b1995a9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.518050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df254-42c4-4246-ae61-802e43b6390b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.523447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.524143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.524427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.524732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.525495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.525806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.528032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.559558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.560116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.560395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.560700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.571730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 255/515] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.571730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.574509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.576006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:23.594427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:23.595336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:23.596169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 261/516] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:23.597238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.599761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.683595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c3ac-ab9f-415c-9a84-9ecbb8871310 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.706993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec473-b982-4f44-91d6-c8c8243b0c46 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.712113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.723490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.724487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.724797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.725170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.736517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.738018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.743761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.744442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.744753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.745055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.745793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.746096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.747551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:23.754479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:23.755565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:23.760952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:23.760952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:23.760952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:23.760952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 256/517] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:23.760952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.775349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 262/518] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.776190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.848216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.868769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bcb7f-a2ee-4430-85e0-4e4f7776347a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.895214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4cfcc-7570-4151-b34e-713aa58e1e38 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:23.903751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.904359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.904663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.904940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.932163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:23.933327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:23.933721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:23.933992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:23.934803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:23.935190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.936796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:23.955306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 263/519] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:23.956246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:23.962762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:23.987634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:23.989147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.068084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530d33-2198-4b56-bdb4-f5626bdbce65 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.089928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.093177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 257/520] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:24.094045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.105576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.106181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.106461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.106728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.107593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:24.107694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.109054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.126144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 264/521] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:24.126144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.184934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.212735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d17b7f-4d13-4f6a-8eee-27aeeff49c72 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.236295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ab2b-b062-45b7-9a9b-1efce07cea36 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.249463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.250069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.250349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.250619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.275029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.275635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.275915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.276996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.278068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:24.278669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.280119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.296609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 265/522] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:24.296609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.343758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.353894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.356156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.422246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7106-b534-42e4-b704-9284f34cd746 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.457705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.468105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.469244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.469722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.470185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.484778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.486563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.487574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 258/523] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:24.488541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:24.504139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:24.505299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:24.506345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:24.506345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:24.506345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:24.508174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 266/524] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:24.509246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.596328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b60b12-7b45-4531-b166-938668e7dee7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.609153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.617508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccded12-5ed0-48f6-a227-14273b0a33b1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.633399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.634109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.634515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.635112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.643157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.644818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.657289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:24.657678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:24.658758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:24.659935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:24.661183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.661618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.662019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.666249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 259/525] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:24.667241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.675222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.676945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:24.692604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:24.693759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:24.694620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:24.694620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:24.694620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:24.696662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 267/526] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:24.697681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.711785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.797580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24344d-7eef-49aa-98e8-11112599187e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.806640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f133b9-bd90-42fe-b6bb-f136211ee1d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.837064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.837778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.837960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.838198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.838989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:24.839309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.840705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.847047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:24.847938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:24.848417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:24.848923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:24.850130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:24.850632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:24.852258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:24.853998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 260/527] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:24.855497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.872918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 268/528] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:24.874025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:24.884869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.960798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:24.966182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdb005-d1ad-460a-b274-6b538886b8c0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:24.983546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ba2bf-154c-43d6-acc7-7193129d6d29 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.002742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.003349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.003624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.003893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.004536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.004878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.006272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.018979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 261/529] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.020101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.023485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.024674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.025189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.025670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.033558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.035309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:25.048269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:25.049331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:25.050395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:25.052302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 269/530] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:25.053340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.124428 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.141895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d1cc-70df-4f3d-8795-be06e534a089 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.164851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237534e-cb36-47d8-8124-92d02dbe0aba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.178466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.179078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.179353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.179624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.202538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.203434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.203860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.204260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.208928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.212734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.216208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:25.230440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:25.231351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:25.232195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:25.234746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 270/531] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:25.235859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.257578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.259263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.342277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255341d-eca9-4358-a444-ac5e1244ad1b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.362158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 262/532] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:25.367351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.370935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.381038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.382825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.383329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.383801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.384761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.385267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.387141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.406695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 271/533] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.408634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.430404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.474624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373f2a-b59e-4386-afef-75d29995b32f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.512463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.513549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.513999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.514718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.515525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.515841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.517454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.522571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84b8e-411a-408b-8b0f-aabbd87bde2d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.548939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 263/534] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.549988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.564023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.565013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.565517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.565986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.577568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.579288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:25.595418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:25.596361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:25.597578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:25.597578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:25.597578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:25.599653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 272/535] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:25.600670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.643235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.663789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b2078-e109-4a51-879e-35121b8ae890 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.682899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:25.701763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.702370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.702651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.702922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.703654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=07e473709ec4428db98fb7cd9009d644) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.703963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.705433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.708720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960600a-16e9-4385-afe0-a1ad6d3bab58 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.711530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 264/536] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/role_assignments?user.id=07e473709ec4428db98fb7cd9009d644&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.711991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:25.766604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.767628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.768062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.768493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.769708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=cdc5670d29254a6095b0469caf7b616f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.770712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.772700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341305-56bc-4e0f-8fa9-fde09ef566de None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.781967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 273/537] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/role_assignments?user.id=cdc5670d29254a6095b0469caf7b616f&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.783556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701f14-5b4f-40b7-89ab-4e5b83f51aa6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.783971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701f14-5b4f-40b7-89ab-4e5b83f51aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.784374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701f14-5b4f-40b7-89ab-4e5b83f51aa6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.786296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 274/538] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:25.792890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.792890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.792890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.813382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:25.814608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:25.908856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 275/539] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:12:25.918200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0e8c8-6fb0-42f9-b200-f3ccc76072d4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:25.957671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:25.958288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:25.958562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:25.958827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:25.959485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:25.959784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:25.961267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:25.977354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 265/540] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:25.983326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.019143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:26.094085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad710c8-852c-4434-ae33-10b897a6ba3a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:26.138697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:26.139320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.139578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.139846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.146843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:26.148282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:26.160553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:26.161432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:26.162337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 276/541] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:26.168939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.232598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:26.305556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2201e-77ab-4868-bd1f-e3a835d47b50 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:26.315467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.350508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:26.351643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.351923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.352345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.353077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:26.353387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:26.355420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:26.370681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 266/542] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:26.379024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.512058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3286c-3a0a-457a-a735-4aa54dc71883 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:26.514097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:26.553359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:26.555602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:26.556689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.557174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.557809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.559877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=443218c09bc54d46a7d97a9208d9d100) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:26.560402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:26.563050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:26.570319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427585d-1fdf-405c-8051-2143f686202c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:26.570580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 267/543] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:26 2022] GET /identity/v3/role_assignments?user.id=443218c09bc54d46a7d97a9208d9d100&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:26.612659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:26.613680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.614186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.614656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.628353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a92a6fc6-95f1-4cc8-917f-edbc945966ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:26.633896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:26.634896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:26.636228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:26.638568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 277/544] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:26.645730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.736621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c1a-ae70-443e-be8c-3cf175836c8e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.736939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c1a-ae70-443e-be8c-3cf175836c8e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.737172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4c1a-ae70-443e-be8c-3cf175836c8e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.738645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 278/545] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:12:26.744289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.744890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.746533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.775017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:26.776425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:26.826782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef165d-ce23-48cf-89ed-21bedc396a1c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:26.862029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 279/546] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:12:26.881545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:26.882161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:26.882435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:26.882702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:26.883375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:26.883674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:26.885079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:26.894599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 268/547] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:26.900332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:26.992486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:27.013292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9023c8-a915-4cbe-b908-d8ebf39084ed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.059390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.060012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.060289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.060561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.076640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:27.078077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:27.095882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:27.097012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:27.098113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:27.098113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:27.098113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:27.098113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 280/548] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:27.103160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.145743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:27.220054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.234735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdfb2-667d-4233-89a8-2ec5d18e0c8a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.306778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.307383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.307723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.308076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.308843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:27.309144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:27.310581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:27.337436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 269/549] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:27.343518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.407168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf4ea-9630-47df-a1e5-24e1bf3c3896 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.487206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.487832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.488104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.488372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.491311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:27.499223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:27.507948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:27.518227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:27.519379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:27.520199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 281/550] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:27.525377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.528251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4923d5-3cae-409b-a791-6ee41ac2819f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.595906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.598729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.599485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.599955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.621817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:27.623317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:27.650187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:27.651722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:27.652862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:27.661012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 270/551] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:27.680351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.685945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b230dc-5690-4aab-a27d-df225b587119 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.734853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.735466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.735747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.736015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.737877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:27.738182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:27.739575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:27.758604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 282/552] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:27.765313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:27.859938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4323-56b6-47af-a2f2-645a7091e84c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.892105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:27.954309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ab792-aed9-4fb5-81ac-33dca01f6257 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:27.957283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.957911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.958193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.958536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:27.959354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:27.959661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:27.961203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:27.991617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:27.992302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:27.992610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:27.992890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.005259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.006730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.006864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 271/553] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:28.012321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:28.022070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:28.023013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:28.023890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:28.023890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:28.023890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:28.023890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 283/554] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:28.028731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.033318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.149341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7954e8-2ac6-489c-965f-9e2922c01519 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.159131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.196314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.196965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.197247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.197523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.198337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:28.198736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.200118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.219132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 284/555] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:28.220130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.221456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd895e-13ca-4649-a436-c2b6c3129825 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.259556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.260166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.260428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.260770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.342546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.344069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16fee9-cc59-4478-b8f0-126e4faaa818 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.353742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.429243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1176c0-e962-477b-9f5e-a7ea989a52c3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.468979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.469604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.469883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.470304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.478878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 272/556] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:28.478878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc326f-8996-4d8c-8f6e-2b6af50ec806 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.478878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc326f-8996-4d8c-8f6e-2b6af50ec806 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.478878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc326f-8996-4d8c-8f6e-2b6af50ec806 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.478878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 273/557] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:28.479337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f703-2004-4dae-b20c-c394fdf9f603 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.479433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f703-2004-4dae-b20c-c394fdf9f603 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.480082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f703-2004-4dae-b20c-c394fdf9f603 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.484709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 274/558] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:28.484709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2f703-2004-4dae-b20c-c394fdf9f603 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.486410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.487914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-847f8f0e-fab5-445e-bac3-24ad109028d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:28.503132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:28.504068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:28.505056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:28.509013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 285/559] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:28.510198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202964e-5e4a-4076-bebd-28c5d13262c4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.510750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202964e-5e4a-4076-bebd-28c5d13262c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.511090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202964e-5e4a-4076-bebd-28c5d13262c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.529059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6202964e-5e4a-4076-bebd-28c5d13262c4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:28.530296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6202964e-5e4a-4076-bebd-28c5d13262c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:28.553424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.591168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2f703-2004-4dae-b20c-c394fdf9f603 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.598338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.612855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 286/560] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:28.620450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.620450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.620450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.633996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:28.634402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.635095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.635412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:28.636055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.636308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.647313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.648948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:28.665536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:28.666533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:28.667494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:28.667494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:28.667494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:28.667494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 275/561] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:28.667494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.707701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 287/562] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:28.708596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.774749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74554b46-8ead-431e-9c8a-c81b9e434a4c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.798642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.811053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.811751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.812128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.812476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.813309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:28.813686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.814478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834451c-34ce-477f-9182-a42e0ecc845e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:28.815455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.836696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 276/563] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:28.842944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.853144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:28.854070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:28.854564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:28.855330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:28.856227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:28.856736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:28.858316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:28.862893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:28.871381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 288/564] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:28.881550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:28.986816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029a39-7abb-43d2-aa19-fd7adb820aba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.018750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fc42e-49cc-4be3-b633-15ebb349eb73 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.021773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.022474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.022818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.023152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.030775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.032331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:29.045672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.046733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:29.047785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:29.048546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 289/565] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:29.049398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.061551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.064390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.065057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.065404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.065920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.077976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.079613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:29.096681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.097637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:29.098502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:29.098502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:29.098502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:29.098502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 277/566] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:29.099406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.168374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aefcd-9756-4786-83d1-aa84507385fc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.172961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.213962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.214737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.214897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.215159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.217008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8bcd7-1e21-4c27-b0c3-1d6a7008b1e2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.227449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:29.233799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.234742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:29.235557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 290/567] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:29.236234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.258216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.258770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.259023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.259301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.259979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:29.260528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.262626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.280826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 278/568] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:29.280826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.309592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.345197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fefd9-62b5-466c-9f11-8fc576a9dfe2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.379603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.380165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734d34f-a917-4a36-9838-acf261664ebc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.380277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.380465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.380773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.381412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:29.381724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.383086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.394620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 291/569] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:29.397452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.406545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.414469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.415113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.415383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.415647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.426197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:29.430963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.432063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 279/570] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:29.433304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.500278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d02c-ede5-4ac9-8c95-d1bf669c7c1e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.527639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.536465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.537086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.537362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.537629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.538285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:29.538583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.539927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15ed6-8632-4d08-92b4-700040ee4e0f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.545017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd220a-1174-49c3-8bc5-3240fb9ac717 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.547566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 292/571] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:29.548737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3052-2f02-4ce1-99ef-a1d54813c232 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.549016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3052-2f02-4ce1-99ef-a1d54813c232 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.549282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca3052-2f02-4ce1-99ef-a1d54813c232 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.550695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 293/572] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:29.551168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3052-2f02-4ce1-99ef-a1d54813c232 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.583238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.583833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.584110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.584379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.585161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=72e8f4cb893a4a119ffa520b2b7f6efc) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:29.585466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.586887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.592596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 280/573] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/role_assignments?user.id=72e8f4cb893a4a119ffa520b2b7f6efc&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:29.593378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.650810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.671572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca3052-2f02-4ce1-99ef-a1d54813c232 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.702488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a9ed3-9e02-44d7-a886-0125068ffc3c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.719376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.720114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.720658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.721003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.731692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.733929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.739759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.740484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.740819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.741094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.741775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:29.742084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.743468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f785a19-a025-4cb2-a1b8-ee227553f3cb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:29.748306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.749256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:29.750157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:29.751328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 294/574] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:29.752393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.757103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 281/575] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:29.758750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.759302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.759798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.779236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:29.780361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:29.813030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.849935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 282/576] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:29.859623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:29.859756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a641f-d691-4658-b4b8-961d43febc08 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:29.904564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:29.905199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:29.905471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:29.905738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:29.922051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:29.924083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:29.926170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:29.945818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:29.946975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:29.948198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:29.948198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:29.948198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:29.954660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 295/577] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:29.954660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.004365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d005e9-0196-4e9d-8ac4-76f4935e72da None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.053695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.054951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.055687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.056162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.057748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:30.058247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.060458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.066456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c669-5868-4a5d-b180-d02500254476 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.068065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.081914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 283/578] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:30.083386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.108384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.109158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.109502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.109855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.121465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.123019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:30.139420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:30.140410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:30.141472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:30.141472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:30.141472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:30.141472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 296/579] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:30.141472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.209044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f713da-71c7-4b3f-a03a-f0d2970a9908 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.211415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.245642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.246236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.246523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.246798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.247441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:30.247742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.249183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.252374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887c0f-809c-41e2-aa0e-ed86c07d3122 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.266131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 284/580] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:30.266131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.293579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.294343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.294620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.294897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.310542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=00af7c59942242d5ba2517f2c1b07d9a, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.312033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.336614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 297/581] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:30 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:30.336614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.338906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.400747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a00563-b07f-4aad-929b-3a7b17763b14 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.443976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.444851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.445208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.445555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.459617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:30.466185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:30.467233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 285/582] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:30.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.495384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e02583-8f71-4df2-907a-54fda636a1ee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.499990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.538575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.539189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.539467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.539735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.540413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:30.540746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.543385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.556664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 298/583] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:30.557680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.597864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74739955-55df-44c5-9850-b44450cc36e6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.623774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.647314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.648480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.648984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.649622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.661296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.663643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.667700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076107d-c1cd-4f0a-a4d4-f6b5329cc1d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:30.679138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:30.680255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:30.681414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:30.688478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 286/584] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:30.688478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.721425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.722546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.723010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.723676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.725162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:30.725880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.727460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.738930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 299/585] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:30.739947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.782711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.802135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdab12-4be5-49b4-b7d8-5854d1fdfaf5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.839766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.840546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.840955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.841325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.849930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.851406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:30.864873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:30.866044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:30.867048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:30.867564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 287/586] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:30.873762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.878767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736099d-2463-4b0e-87a5-ff28fef42c89 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:30.905608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:30.920483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:30.921243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:30.921598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:30.921949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:30.923234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:30.923907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:30.925829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:30.956089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 300/587] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:30.956089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:30.998905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201c966-f39d-4b33-9804-0bf2b732e7a2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.041195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.042588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.043196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.043614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.062212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.063982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.067882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.082015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6095e3-2ed3-4c22-b1ab-df38c2e5cc86 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:31.085392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:31.086466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:31.087334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:31.087334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.087334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:31.089945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 288/588] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:31.090971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.126425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.126931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.127206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.127472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.128214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:31.128679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.129943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.150763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 301/589] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:31.152762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.208211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.213379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2482bf-87e3-4899-89c8-d818b73e056f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.251329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b41a8-8890-491b-bf54-536579032976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.251962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b41a8-8890-491b-bf54-536579032976 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.252245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b41a8-8890-491b-bf54-536579032976 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.252521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b41a8-8890-491b-bf54-536579032976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.265067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b41a8-8890-491b-bf54-536579032976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.266570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b41a8-8890-491b-bf54-536579032976 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-002b41a8-8890-491b-bf54-536579032976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:31.282102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:31.283111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:31.284006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:31.284006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.284006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:31.284006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 289/590] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:31.284245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b41a8-8890-491b-bf54-536579032976 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.285269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a56ec-70c8-4bc4-8157-aa5f9108b691 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.328922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.329871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.330345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.330805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.331668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:31.332161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.334182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.342877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.353490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 302/591] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:31.353645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.405162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b41a8-8890-491b-bf54-536579032976 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.441018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.441646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.441927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.442203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.453522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.454983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.467883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc974a-90e3-4bff-9a68-86814ff17d36 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.469653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:31.470608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:31.471516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:31.472399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:31.472399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:31.472399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:31.472399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 290/592] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:31.473043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.509141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.510230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.511022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.511911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.512757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:31.513225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.514772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.528525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 303/593] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:31.529720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.593290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.597370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677fcb-98e3-4a0b-bb8d-86d603aa5199 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.639566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.640342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.640650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.640954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.649171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.649963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962946be-b0ce-42b9-b767-73aa881ac46f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.650657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:31.663921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:31.664887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 291/594] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:31.666215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.688503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.689160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.689441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.689713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.690363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:31.690664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.692044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.705973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 304/595] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:31.706822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.739656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.797364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6b14-d1ea-4782-86ba-8f3607e0f1a6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.838234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.840084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.840378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.840695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.847971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.848112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b62db-bee3-4dd1-bd49-ed0fa9651362 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:31.849718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:31.863686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:31.864832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:31.865797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:31.868919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 292/596] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:31.870126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.891873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:31.892978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:31.893258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:31.893527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:31.894260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:31.894562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:31.895967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:31.899705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:31.915466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 305/597] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:31.916212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:31.988758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06833c6d-4e2e-4584-9403-0d16e33b2bd5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.005946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.026256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.027368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.027616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876587ff-d65e-4278-ab42-f0c6db296d00 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.028123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.028635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.035595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.037309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3c3084d1-1477-4485-88b3-01916abb7a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:32.049679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:32.050685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:32.051613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:32.053985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 293/598] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:32.055226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d3e16-491a-4b85-ba6d-e382b657dcb7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.055575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d3e16-491a-4b85-ba6d-e382b657dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.055918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d3e16-491a-4b85-ba6d-e382b657dcb7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.057872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 294/599] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:32.058517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d3e16-491a-4b85-ba6d-e382b657dcb7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.070402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.071005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.071281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.071548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.072239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:32.072540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.074686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.087066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 306/600] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:32.093444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.149530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.172866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d3e16-491a-4b85-ba6d-e382b657dcb7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.205276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea14-41d8-4746-b670-c479e57a2804 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.211223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.211862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.212143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.212419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.223580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.225333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-26aeedb7-1862-41eb-a66c-cf2ecf6b5982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:32.240337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:32.241501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:32.242376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:32.242376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:32.242376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:32.244508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.245622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.245902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.246644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.246762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 295/601] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:32.246995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:32.247298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.247666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.247951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.248228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.248724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.258663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.263882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 307/602] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:32.265032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.269681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:32.270895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:32.342275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 296/603] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:32.343131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.380625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19978d55-84a5-4ea4-b239-beab2584f69f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.418013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.418615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.418887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.419152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/07e473709ec4428db98fb7cd9009d644/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.435713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.436399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=07e473709ec4428db98fb7cd9009d644, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.438744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.453127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 308/604] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:32 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/07e473709ec4428db98fb7cd9009d644/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:32.454352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.487321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec695-e790-4e06-bae9-aa4809a7bbca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.563343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.564494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.568666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.569021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.569295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.569994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:32.570298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.571710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.608683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 297/605] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:32.614355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.639568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3364-1187-469f-8282-c4118c1a66d0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.693883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.694468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.694745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.695013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/cdc5670d29254a6095b0469caf7b616f/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.720028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=cdc5670d29254a6095b0469caf7b616f, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.721521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d091f6-8548-402b-9ec7-eb0705254768 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.735386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 309/606] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:32 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/cdc5670d29254a6095b0469caf7b616f/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:32.738355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e572-0b0b-4733-a621-d45d5f358c3b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.738881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e572-0b0b-4733-a621-d45d5f358c3b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.739341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e572-0b0b-4733-a621-d45d5f358c3b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.742206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 310/607] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:32.743420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206e572-0b0b-4733-a621-d45d5f358c3b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.761749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebe337-09d9-4b7a-b96d-be0ac666dd7e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.801898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.819467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.820864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.821394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.821976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.832896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:32.835249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3c2ea936-3089-4fca-bb33-7ccccf09ce21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:32.854416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:32.855384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:32.856276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 298/608] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:32.857536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.857536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.862611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.887079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:32.889476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:32.894662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:32.899455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206e572-0b0b-4733-a621-d45d5f358c3b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:32.946561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:32.947114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:32.947392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:32.947657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:32.962376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:32.967856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:32.968962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 311/609] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:32.969808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:32.985558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 299/610] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:32.986886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.102245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a4ca-3254-43c2-b03a-67bd975e7281 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.136956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.147123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb980-0546-4486-b744-2bcc48c75870 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.184443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.185231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.185605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.185976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.186787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:33.187193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.188841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.196822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.196822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.196822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.196822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.198599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:33.198599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.199955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.205777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 312/611] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:33.210891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.225501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 300/612] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:33.231830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.253888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.356615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b3826-76f2-4c53-83b7-4761694e7af2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.393677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898690-4c45-446c-8cc8-3d73ff05e466 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.403927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.404670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.405453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.405732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/443218c09bc54d46a7d97a9208d9d100/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.424678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=443218c09bc54d46a7d97a9208d9d100, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.427059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.435736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.436566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.436929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.437304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.445006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 313/613] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:33 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/443218c09bc54d46a7d97a9208d9d100/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:33.446583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.450713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.452354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:33.471432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:33.472721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:33.473860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:33.473860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:33.473860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:33.480340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 301/614] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:33.481491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.514401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.564423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.622451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e383343-b786-425b-90a8-844b785eb4cc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.679373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27413-1678-4e8f-866f-8b018420bf37 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.683074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.683721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.684000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.684266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.705698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:33.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:33.711698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:33.712544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:33.715226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 314/615] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:33.721212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.736970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.737554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.737858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.738130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.738792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:33.739096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.740726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.758429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 302/616] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:33.767432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.892165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a40fa-f8c0-4bc6-a8f7-99e9037b4a1b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:33.935527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.941196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:33.942805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:33.943635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:33.943917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:33.944193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:33.944963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:33.945269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:33.946660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:33.958084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 315/617] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:33.963524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:33.975697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3514f-e4eb-485e-af15-025051f28745 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.070739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.071803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.072269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.072778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.095974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa24a3-b2e6-4c6f-b953-672dc714904c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.097697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.099420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:34.127072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:34.128096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:34.129041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 303/618] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:34.137542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.154015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.154665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.155025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.155303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.172128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.174166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:34.191634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:34.192808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:34.193682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:34.193682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:34.193682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:34.193682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 316/619] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:34.202474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.257217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:34.321864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70bda-97f0-4c63-894f-83062c3b6ee7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.362506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.363656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.363941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.364218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.364907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:34.365214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.366641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.381728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 317/620] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:34.387077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.434769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953c99b-2347-47d3-8a1e-3483094bf906 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.506935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529a2f0-b2dc-4bad-a790-80fb6338a68e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.509342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:34.521309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.522076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.522458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.522829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.523692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:34.524101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.525671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.547800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.548771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.549322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.549776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.557728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.559587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.562887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 304/621] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:34.569520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:34.573519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:34.574474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:34.575438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:34.578472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:34.580030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 318/622] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:34.586512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.701019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081eaec-c266-404d-b8cd-2484aaead188 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.739989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.740944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.741373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.741812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.743002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:34.743448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.745584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.765474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 319/623] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:34.770617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.816200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a00c9-36ed-4fa4-8100-6cdce364acc9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:34.834632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:34.863582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9811-e778-40bb-9558-864bf242634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:34.864743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9811-e778-40bb-9558-864bf242634b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.865234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9811-e778-40bb-9558-864bf242634b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.865749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9811-e778-40bb-9558-864bf242634b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.879874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9811-e778-40bb-9558-864bf242634b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:34.882046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9811-e778-40bb-9558-864bf242634b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-053e9811-e778-40bb-9558-864bf242634b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:34.902792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:34.904034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:34.904971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:34.904971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:34.904971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:34.907433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 305/624] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:34.917481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9811-e778-40bb-9558-864bf242634b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:34.997404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fe333-29f6-44e2-b1cf-e9c3023c7e1a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.020508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.047593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.048566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.049109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.049449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.073729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9811-e778-40bb-9558-864bf242634b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.118010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.118895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.119182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.119466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.120190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:35.120499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.122671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962d5c-780e-4fe2-a357-7167fcae1aa8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.141180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 306/625] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:35.142534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b448d-2541-4da2-9940-892eafdffec2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.143147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b448d-2541-4da2-9940-892eafdffec2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.143428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b448d-2541-4da2-9940-892eafdffec2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.145892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 307/626] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:35.147460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b448d-2541-4da2-9940-892eafdffec2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.152976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.154489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff419668-9b05-41a8-97db-45bc9ed5b83e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.179798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.258834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 320/627] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:35.260079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.260368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.260882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.276779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b448d-2541-4da2-9940-892eafdffec2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.280223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:35.281627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:35.295283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.314707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.315333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.315618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.315893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.322637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.324827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-19407f8e-f6e9-4dfa-91e2-f2a931ac853c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:35.336206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:35.337305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:35.338239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 308/628] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:35.339497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64ec2-e323-44cb-b67c-b3fbd0a6d3d2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.339854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64ec2-e323-44cb-b67c-b3fbd0a6d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.340046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf64ec2-e323-44cb-b67c-b3fbd0a6d3d2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.345283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 309/629] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:35.345283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64ec2-e323-44cb-b67c-b3fbd0a6d3d2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.363392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 321/630] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:35.364132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.435611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.463231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf64ec2-e323-44cb-b67c-b3fbd0a6d3d2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.496370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7155699-cdf9-42f7-9f6e-b7926d0f0a6f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.511603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.513062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.513769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.514221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.530337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.531662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.536863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.538041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.538500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.538941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.540377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:35.540887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.544374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-53a1d11a-0621-4efe-9ea6-736e0f46954c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:35.549116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:35.550067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:35.550965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:35.550965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:35.550965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:35.550965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 310/631] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:35.552525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.552896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.553235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.561531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 322/632] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:35.562602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.578976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:35.580254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:35.606464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.655784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 311/633] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:35.656635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.696692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b4940-3f99-420c-830d-c043999fb91c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.712863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.738427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.739596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.739596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.739596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.740181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:35.740480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.741878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.756670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 323/634] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:35.757378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.773939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff1374-1bbf-456c-b560-f26ce4586980 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.820120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.820871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.821155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.821428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/72e8f4cb893a4a119ffa520b2b7f6efc/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.842690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=72e8f4cb893a4a119ffa520b2b7f6efc, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.844285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.864681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 312/635] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:35 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/72e8f4cb893a4a119ffa520b2b7f6efc/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:35.866441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.898596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:35.928042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33a7dc-82c7-4b4f-aeb9-2677a8980ef7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.990037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.990889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.991250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.991578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.005675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:36.011314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:36.012442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:36.013308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:36.017628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 324/636] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:36.018723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.047933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28497e-1777-46d5-bb32-2340c5fb8839 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.071231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.099735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.100365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.100676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.100949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.108218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.109698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:36.121474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:36.122407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:36.123318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 313/637] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:36.123806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.159086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bdb5-5a0f-4e68-aec6-263d2525290c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.199739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.199739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.199739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.199739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.211071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:36.214525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-112e5732-97e6-41c3-98db-b306c716c4a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:36.217256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:36.218259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 325/638] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:36.221770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f726-3f0c-480b-a77d-0d27944339fa None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.222519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f726-3f0c-480b-a77d-0d27944339fa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.222519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0f726-3f0c-480b-a77d-0d27944339fa None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.226095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 326/639] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:36.226879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f726-3f0c-480b-a77d-0d27944339fa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.268409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5773448-5af1-446e-8113-d4cf64bfcc92 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.305751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.306410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.306690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.306956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.307618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:36.307913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.309305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.317179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 314/640] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:36.317990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.333975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.346162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0f726-3f0c-480b-a77d-0d27944339fa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.384977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.386979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.387440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.387886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.388753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:36.389236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.390897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b8204-65df-4965-bd5d-4d469c9c9458 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.403798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 327/641] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:36.405070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.405357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.405630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.425339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:36.425538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a6dd-4125-4520-8f76-2b53cdc90f24 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.426535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:36.453975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.460995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.461927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.462207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.462479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.463145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:36.463449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.466340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.479848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 315/642] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:36.479848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.512608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 328/643] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:36.512608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.607341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.617662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf232a-dd08-4f38-8424-75ddc7c5afc5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.628204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1e3c7-06e0-431d-8ceb-9b438dab2192 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.669757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.670357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.670639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.670905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.674840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.675680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.676178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.676684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.677659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:36.678595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.680670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.681890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.683856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.697084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 329/644] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:36.699663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:36.700338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:36.701373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:36.702850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:36.702850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:36.702850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:36.708630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 316/645] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:36.710755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.799721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.877878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30738519-e0da-4796-96a4-e98c39833b25 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.880956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0cff8-e77c-47e5-bfe5-36bccb6b7bb8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.917721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.918718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.919058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.920004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.920891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.921685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.922142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.922917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.923052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:36.923327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.925275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.931765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.933554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.938028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 317/646] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:36.939178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.941782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:36.952983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:36.953941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:36.954963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:36.954963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:36.954963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:36.958802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 330/647] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:36.959659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.057668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876d0f-c31c-4749-a2c9-faa5b6aef03b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.084977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.090343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5751f1-5a4e-49e3-80b1-550752ca54cd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.105520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.106397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.106967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.107200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.122667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:37.129755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:37.130888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:37.131895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:37.132533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.132986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.132986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.133272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.135197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 318/648] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:37.137974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.144039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.145616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:37.161601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:37.163507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 331/649] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:37.165370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.241175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.286706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224f19-3af8-45af-bfee-95999c51ab1e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.288503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55b342-6931-479e-9462-b5e1ad9938dd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.321789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.322532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.323056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.323598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.324493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:37.324924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.326376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.336344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.337208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.337622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.338051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.339354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:37.339980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.341028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 332/650] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:37.341716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.342085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.358249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 319/651] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:37.360180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.396988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.469702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337a88-b2b9-4d76-b4bd-b768243362cc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.479623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e1b7e-ab6f-4753-9b4b-d7da22bbedae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.498847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.521276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.521479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.521965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.522246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.522522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.522716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.523127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.523263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:37.523575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.523802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.525247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.537139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.538945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.549682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 333/652] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:37.549682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:37.559660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:37.560666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:37.561583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:37.561583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:37.561583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:37.564744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 320/653] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:37.565937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.652600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b79e-d6b8-4522-8380-dbd472c76467 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.659812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.687043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.687681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.687962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.688235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.689095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6505b-b96d-4a36-87df-89e8fb7eddf2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.695740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.697461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:37.709633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:37.710640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:12:37.711596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:37.715991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 334/654] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:37.716883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.732008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.733101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.733605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.734137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.758593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.817004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.819260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.822784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e7586-8048-4d0a-9f69-46f3f66aa742 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:37.858183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:37.858719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.859004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.859652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.860690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:37.860690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:37.862069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:37.878325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 335/655] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:37.879326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.910958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.946465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 321/656] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:37.947792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:37.980183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.983766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a2ac-4a86-4bf9-b715-7f8947c94a65 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.019433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.020066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.020530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.020662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.021355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:38.021692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.023131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.048554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 336/657] 10.222.0.71 () {56 vars in 1137 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:38.049872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.068355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7c350-7eb1-44cb-995a-1cd35149807d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.108331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.109476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.109958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.110518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.118753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.120879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:38.134599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:38.135636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:12:38.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:38.139352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 322/658] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:38.140314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.161241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbca5c-5061-4589-8b5e-356d44bb785b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.183989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.201352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.202252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.202691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.202967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.214966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.216402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:38.233203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:38.234185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:38.235085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:38.235085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:38.235085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:38.235085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 337/659] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:38.235085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.250706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.260032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8138e7-8a54-43ba-8c21-40c6795387ec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.295853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.296464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.296915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.297188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.343427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8a508-8db2-416a-8f77-6321ab550cbc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.370286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.372000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.380078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.380749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.381029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.381644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.382370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:38.383028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.384489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b780c3b-499a-4a0a-9113-1e18ff1f84a8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.403420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 338/660] 10.222.0.71 () {56 vars in 1139 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:38.404680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbebc4-53b1-4ebc-b048-6bdc310b4d27 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.404965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbebc4-53b1-4ebc-b048-6bdc310b4d27 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.405235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbebc4-53b1-4ebc-b048-6bdc310b4d27 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.409739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.410581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 339/661] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:38.411228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbebc4-53b1-4ebc-b048-6bdc310b4d27 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.480219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 323/662] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:38.481558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.492980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.530143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbebc4-53b1-4ebc-b048-6bdc310b4d27 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.566122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.566748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.567005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.567276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.567916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:38.568217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.569680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d2b7a-2432-4943-8f94-44cc3d1f77c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.585118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281467b2-9e29-4604-bde1-56d7dd22bc0d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.586857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 340/663] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:38.588152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.588429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.589292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.607926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:38.609149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:38.620009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.620854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.621137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.621390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.624881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.692605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 341/664] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:38.692605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.706404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.708846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.741896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.787419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fa06-bf22-49a6-b91c-87dfd2c658ec None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.829255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.829980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.830261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.830535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:38.843887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:38.845368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:38.847582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 324/665] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:38.848570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:38.868899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:38.870401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:38.871284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:38.871284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:38.871284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:38.871284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 342/666] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:38.873669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:38.888008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:38.959421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954a4c9-9f03-4a8e-8a98-4445275ea915 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:38.997677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:38.998212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:38.998490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:38.998759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.006369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.007441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c56c03-c13c-407e-a6ca-56e08a7d7fd2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.007862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.020049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:39.021114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:39.022090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 325/667] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:39.029111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.051407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.052160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.052284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.052540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.064341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.065797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:39.080622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:39.081583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:39.082474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:39.082474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:39.082474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:39.082474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 343/668] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:39.082474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.133423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.140114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea3db-05e5-4b74-8262-23b0053bfbf8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.173854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.174456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.174737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.175009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.175643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.175941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.177344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.186064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e002ee-675f-4638-ad6a-d09cef7f6db3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.189481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 326/669] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.190275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.222937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.223565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.223835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.224111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.234774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:39.240038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:39.241090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 344/670] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:39.241914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.265550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.293157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c9949-4ed2-487c-a1e3-aae6917f9ca6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.336345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.336974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.337250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.337516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.338200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.338530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.339952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38662a6-fdb1-4bf2-ab0b-496be2379d04 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.344209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc38a9f-b359-4ec3-a94a-67a42abec6ad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.351933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 327/671] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.353190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300e99-e97e-4159-b342-13b0a741ccae None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.353490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300e99-e97e-4159-b342-13b0a741ccae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.353756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300e99-e97e-4159-b342-13b0a741ccae None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.355599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 328/672] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:39.357706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57300e99-e97e-4159-b342-13b0a741ccae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.376980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.379875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.380778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.381061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.381323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.381956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.382252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.383594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.395296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 345/673] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.396084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.461748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57300e99-e97e-4159-b342-13b0a741ccae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.476189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.496868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52de9af-b7fd-4204-abe0-5b9c66c9e339 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.497419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.498049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.498328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.498597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.505141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.506571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:39.518005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:39.518958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 329/674] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:39.520198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.532961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.533567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.533853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.534122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.534785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.535084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.536432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dbc51-04dc-42f0-abc3-447a74f777da None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.545105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 346/675] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.546253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.546538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.546814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.564394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:39.565607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:39.598040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.624950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab823a79-e128-4ffb-9657-6c91c7ed1bca None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.652605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 347/676] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:39.652605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.672661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.673316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.673597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.673865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.674582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=07e473709ec4428db98fb7cd9009d644) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.674995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.676530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.692674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 330/677] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/role_assignments?user.id=07e473709ec4428db98fb7cd9009d644&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.692674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.735724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.781565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a10b1-e596-4d3e-b077-0f8a2ea093c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.827037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.827556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3f8b-4a3b-4ae6-8466-7c9eb66354e7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:39.827845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.828193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.828533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.836824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.838415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:39.852218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:39.853214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:39.854407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 348/678] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:39.855087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.882675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:39.883860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:39.884748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:39.886042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:39.886948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:39.887683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:39.890044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:39.903211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:39.912770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 331/679] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:39.912770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:39.977548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9192-54e6-41aa-91fc-3be8f37b8ea2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.009846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.016282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.016931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.017058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f0383-89be-4d68-beaf-4dacd6b3a047 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.017223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.017480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.029718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.031477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:40.047836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:40.048819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:40.049715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:40.049715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:40.049715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:40.049715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 349/680] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:40.049715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.061043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.062050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.062331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.062603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.063587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.063773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.065211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.078949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 332/681] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:40.079766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.148052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.159184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0d66f-e2be-40d9-969f-e66dd283f7c5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.191579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f51b-18da-4079-9cc9-676c789ddfb1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.194629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.197612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.197612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.197612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.197612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=cdc5670d29254a6095b0469caf7b616f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.197612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.198556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.212622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 350/682] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/role_assignments?user.id=cdc5670d29254a6095b0469caf7b616f&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:40.212622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.252990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.253715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.254080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.254520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.267610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:40.273607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:40.274746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:40.275762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:40.277454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 333/683] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:40.281772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.283746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.366633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5e34-87f8-46f5-bef3-c42b49177e06 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.400468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69552bb5-40f2-435e-917c-b055285aff81 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.414953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.415976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.416348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.417427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.418719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.419663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.421504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.426394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.443036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 351/684] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:40.444079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.457419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.458222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.458600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.459024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.459863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=443218c09bc54d46a7d97a9208d9d100) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.460621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.461881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.469639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 334/685] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/role_assignments?user.id=443218c09bc54d46a7d97a9208d9d100&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:40.470447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.581054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37db7-3a35-4992-830a-056d7f6605dd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.596775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.604037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16242-11ff-4d44-935e-dff2a6dabe00 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.636269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.637563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.638330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.638330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.638928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.639304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.640851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.656636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 352/686] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:40.658275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.665937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.667593 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.668043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.668527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.683907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.686563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:40.702903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:40.703992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:40.704995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:40.707177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 335/687] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:40.712736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.777917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:40.803092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6c3f-645b-4ae7-9ee1-e19adca4b892 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.841242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a1fb-5bb1-4b46-8cec-5ed6ba2a6d77 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.848070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.849098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.849831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.850302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.863267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.865104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.878769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.879419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.879737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.880068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.880831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:40.881134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.882610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:40.884833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:40.886604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:40.887508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:40.887508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:40.887508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:40.889626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 353/688] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:40.897183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.907780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 336/689] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:40.918139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.957380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.088409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1e9c-816b-4302-a0c5-60fed8276aee None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.091460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.095338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e0ba-c044-4598-962f-fa6f46c4aba7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.158295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.159752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.160032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.160310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.165156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.165751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.166032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.166299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.167536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:41.167851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:41.169216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:41.199516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 354/690] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:41.204486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:41.308766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:41.310581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:41.328949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.362706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915d36b-03e1-46c0-b40f-a43344b6e669 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.397316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.397946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.398222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.398492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.405850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:41.407363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:41.421005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:41.422017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:41.422950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:41.423470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 355/691] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:41.430641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:41.459462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 337/692] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:41.464765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:41.466751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.576611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3e8a3-4785-49fb-8dd4-523c7a946772 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.657955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c605fd-8fab-4e3c-a1ef-9336a15fb45b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.676703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.677694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.678029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.678346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.679085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:41.679387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:41.680844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:41.715275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 356/693] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:41.715917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.722568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:41.735743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.736430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.736736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.737009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.754604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:41.756099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:41.794014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:41.795038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:41.795944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:41.795944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:41.795944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:41.799538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 338/694] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:41.805525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:41.863306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9d01-4f24-474a-b28b-8529749724ff None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:41.895152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:41.899095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:41.899706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:41.899980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:41.900250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:41.978787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363ebfa-b22c-4f1b-aee6-91080e2ceb6b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.024524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.025287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.025575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.025845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.027014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:42.027295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.032606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.042555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 339/695] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:42.047865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.065032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.070847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.072296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442a2d-5862-4403-91fb-473c14b1e61d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.196858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a9c5-cd7c-43ed-8e59-aec8dda7701e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.218213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.219691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 357/696] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:12:42.222111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0042-7613-430e-a9b0-c640a2dbeab9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.222961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0042-7613-430e-a9b0-c640a2dbeab9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.223512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a0042-7613-430e-a9b0-c640a2dbeab9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.226140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 358/697] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:42.227562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0042-7613-430e-a9b0-c640a2dbeab9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.242734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.243731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.244011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.244282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.253798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.255234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cbc6d9a1-945b-45df-a150-7d9cbd84107f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:42.271327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:42.272442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:42.273496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 340/698] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:42.273976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.274509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.274509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.303172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:42.304345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:42.364718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a0042-7613-430e-a9b0-c640a2dbeab9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.366736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.400671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 341/699] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:42.402089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.424248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.425321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.425945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.427648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.448556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.451980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:42.487445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:42.488490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:42.489510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:42.489510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:42.489510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:42.490146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 359/700] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:42.497608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.599566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462829d6-0076-40cc-aeb8-7b40ab0e0930 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.603513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.653468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.654087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.654370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.654647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.655344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:42.655647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.657138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.670991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 342/701] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:42.676422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.682029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea0cf4-5de0-4a6f-b177-feec0ba145c0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.741069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.741677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.741952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.742221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.742925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:42.743225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.744613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.758005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 360/702] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:42.763450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.779678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.820485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e82e-7f68-4ce4-a177-5201659afe5e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.867609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.868227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.868517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.868974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.870378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=72e8f4cb893a4a119ffa520b2b7f6efc) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:42.870715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.872505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:42.880366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 343/703] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/role_assignments?user.id=72e8f4cb893a4a119ffa520b2b7f6efc&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:42.882639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65074-eb3d-431d-a565-9340f59ecfce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:42.886120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:42.952093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:42.961209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:42.962718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:42.963339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:42.966536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:42.989554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:42.991115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-391f54da-0885-46de-87a9-d3e9572017b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:43.013179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:43.014175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:43.015087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:43.015087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:43.015087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:43.019797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 361/704] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:43.021415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350ac9-d587-4b99-ad94-95981c5428e2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.021707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350ac9-d587-4b99-ad94-95981c5428e2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.021987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350ac9-d587-4b99-ad94-95981c5428e2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.023709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 362/705] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:43.024600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a350ac9-d587-4b99-ad94-95981c5428e2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.086387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6def874-b28b-4cf7-9b50-8cfe9dafd698 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.115628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:43.135673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.136300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.136598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.136881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.144091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.145893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4dd72f6d-3c7a-485d-917f-6f0158a1e11c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:43.160102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:43.161129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:43.162086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:43.162863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 344/706] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:43.164216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665021-5f8e-4eca-9a0d-e3e417123575 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.164505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665021-5f8e-4eca-9a0d-e3e417123575 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.164802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665021-5f8e-4eca-9a0d-e3e417123575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.171713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a350ac9-d587-4b99-ad94-95981c5428e2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.187273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-33665021-5f8e-4eca-9a0d-e3e417123575 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:43.188637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-33665021-5f8e-4eca-9a0d-e3e417123575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:43.217281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.217916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.218199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.218473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.219138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:43.219679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.220947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.235667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 363/707] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:43.236321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.265291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 345/708] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:43.266976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345daa-c3e4-4c05-ab7b-98ab1c0e96ca None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.267317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345daa-c3e4-4c05-ab7b-98ab1c0e96ca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.267657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345daa-c3e4-4c05-ab7b-98ab1c0e96ca None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.269167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 346/709] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:43.269796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d345daa-c3e4-4c05-ab7b-98ab1c0e96ca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.296567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:43.376735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136824c-00f9-4242-8b26-84a1efa48a5f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.403949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:43.416716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d345daa-c3e4-4c05-ab7b-98ab1c0e96ca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.417165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.417947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.418398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.418759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.419625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:43.420020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.421554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19d4a8-93bb-43bb-9bd2-f84e156cba02 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.436339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 364/710] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:43.437869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.438249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.438616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.457705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.458307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.458632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.459032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.459732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.460064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:43.461265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.461533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:43.497070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 347/711] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:12:43 2022] POST /identity/v3/users => generated 254 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:43.498722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.552616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 365/712] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:43.598154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:43.603194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.629714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45760-e6c4-4fee-888e-f3c758d5bcfd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.709376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.710017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.710267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.710543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.711293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:43.711611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.713199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.727993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 348/713] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:43.730249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36734f-ded6-4592-aefd-3a4cd094d9ba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.746634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:43.771836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.772904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.773383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.773849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.774686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:43.776897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:43.788923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:43.789992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:43.790893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:43.794007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 366/714] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:43.799658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.872560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:43.938906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fcdcd-cdf9-478b-a8a7-e9bae7f0aedf None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:43.996551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:43.997271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:43.997555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:43.997825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:43.998487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:43.998789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:44.000221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:44.008403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 349/715] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:44.010923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159457-33b3-4919-a11a-48af425efc78 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:44.015483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:44.018390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:44.057564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:44.059123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:44.059603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:44.060044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] PATH_INFO: `/v3/services/network` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:44.061327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:44.063602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:44.075665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:44.076686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:44.077527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:44.079095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 367/716] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:43 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:44.085914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:44.149870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4677-d701-4042-aca9-da5d587e60dc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:44.168924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:44.206567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:44.207179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:44.207454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:44.207720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:44.208411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:44.208916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:44.211586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:44.232946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 350/717] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:44.269160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293445-a823-4040-b792-20c4be5ba842 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:44.323473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:44.324083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:44.324548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:44.324853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:44.325491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:44.325790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:44.327144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601cfba-2b67-4883-a506-707722dbcec3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:44.336987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 368/718] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:44.343621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:44.422638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:44.462212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53db2b3-51a0-49d3-9076-b511bb1caf8a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:44.501057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:44.502101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:44.502679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:44.503151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:44.504086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] RBAC: Adding query filter params (type=network) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:44.504631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:44.506227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843d8ac-0777-47ac-bc5c-6cfc12b1e693 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:44.513931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 351/719] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:45.551292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5613a-5dbc-4c94-bff0-149b2bdde6a2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:45.551801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5613a-5dbc-4c94-bff0-149b2bdde6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:45.551878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5613a-5dbc-4c94-bff0-149b2bdde6a2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:45.553439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 369/720] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:45.559242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:45.560095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:45.560599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:45.585530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:45.587037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:45.682843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 352/721] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:46.097636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5613a-5dbc-4c94-bff0-149b2bdde6a2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:46.241900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5613a-5dbc-4c94-bff0-149b2bdde6a2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:46.255151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:46.291466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:46.292557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.293087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.293565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.306215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f34f6aef-a4dd-41cf-8872-f9839973223b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:46.312272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:46.313355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:46.314221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:46.320738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 370/722] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:46.324549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:46.385208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:46.429754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6edbac-d190-4459-a6b6-0707dcd57247 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:46.464036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1060a-ebcd-4aaa-b914-01d6b8e176af None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.464780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1060a-ebcd-4aaa-b914-01d6b8e176af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.465252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1060a-ebcd-4aaa-b914-01d6b8e176af None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.467774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 371/723] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:12:46.472100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.472696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.473161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.477838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:46.478451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.478737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.479057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.479808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:46.480109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:46.481744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd6102-890f-43a4-8278-97d2897b3989 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:46.493863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 353/724] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:46.493863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b0fd-51a4-4ec3-bb8e-e227584bc9dc None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.493863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b0fd-51a4-4ec3-bb8e-e227584bc9dc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.493863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094b0fd-51a4-4ec3-bb8e-e227584bc9dc None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.493863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 354/725] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:46.501851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.502141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.502418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.502628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:46.503989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:46.526694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:46.527792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:46.595233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 372/726] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:46.596784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:46.633098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 355/727] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:46.743304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:46.751405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57e81-5838-4cbd-9347-fed74c2819ac None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:46.795196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:46.795823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.796098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.796369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.812128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:46.813589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:46.831049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:46.832344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:46.833618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:46.833618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:46.833618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:46.833618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 373/728] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:46.839555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:46.908986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:46.957093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:46.961814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd6db-5c0f-45bc-914b-f82d71d31184 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:46.997586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:46.998116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:46.998390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:46.998656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:46.999889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:46.999889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.000953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.013656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 356/729] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:47.021721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.154753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf63140-8e62-493c-b93a-b371175e354c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.156877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f043-e92b-49dc-b6ff-da8eedecb044 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.169898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.195285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.196023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.196302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.196411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.196657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.197063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.197344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.197615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.209467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:47.209643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.210928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:47.215086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:47.216030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:47.216891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 374/730] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:47.217594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2d2a5462-5a33-4dd5-a910-b958a547a394 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:47.225139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:47.226154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:47.227228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 357/731] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:47.228332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dcdd-e09a-47ec-a2bf-37f9387a326c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.232133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.232426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dcdd-e09a-47ec-a2bf-37f9387a326c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.232426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dcdd-e09a-47ec-a2bf-37f9387a326c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.234309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 358/732] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:47.235351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dcdd-e09a-47ec-a2bf-37f9387a326c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.322404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d768a-60e2-43eb-912a-125752173499 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.340391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dcdd-e09a-47ec-a2bf-37f9387a326c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.361046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.361716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.362020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.362338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.373794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:47.374670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.375272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.375553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.375828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.376493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:47.376834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.378208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a851fc-c7dd-40cd-a78b-1ed1ff184db7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:47.379189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:47.380065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:47.380910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 375/733] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:47.381814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.394024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 359/734] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:47.394024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ad0e-e9fb-486c-978b-903b3b9153b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.394024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ad0e-e9fb-486c-978b-903b3b9153b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.394024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ad0e-e9fb-486c-978b-903b3b9153b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.408230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8382ad0e-e9fb-486c-978b-903b3b9153b5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:47.409429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8382ad0e-e9fb-486c-978b-903b3b9153b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:47.436520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.447526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.477435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 360/735] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:47.478683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d684-a481-474a-b84e-ce3983f00ac3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.479494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d684-a481-474a-b84e-ce3983f00ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.479786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d684-a481-474a-b84e-ce3983f00ac3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.484667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 361/736] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:47.484804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0a336-fdad-4981-8c37-135d92b48df7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.484986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d684-a481-474a-b84e-ce3983f00ac3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.517488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.518136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.518443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.518727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.519472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:47.519803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.521482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.541143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 376/737] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:47.545690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.602095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d684-a481-474a-b84e-ce3983f00ac3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.641641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.642522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.642803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.643071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.643889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:47.644504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.645903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030e32b-99cf-4123-86c9-f473ddf867e5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.649902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ebe5-fe36-4222-9379-36b9070f841b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.655184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 362/738] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:47.656360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.656669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.656943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.674745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:47.675931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:47.681644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.692163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.692818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.693100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.693386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.697800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.704070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.705894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:47.722243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:47.723238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:47.724111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:47.724111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:47.724111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:47.724111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 377/739] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:47.724111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.757422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 363/740] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:12:47.758323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.830214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f45c9-894b-4223-a91d-457aee5fbacf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.865788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.866633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.867063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.867333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.873449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4aea8-4d84-45f6-b1cc-f44bd365b0d9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:47.914973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:47.915597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:47.915871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:47.916135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:47.917300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:47.927072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.928512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.940430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:47.941884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:47.945221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:47.946135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:47.947009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:47.947009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:47.947009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:47.949838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 364/741] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:47.950837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:47.961592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.049449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 378/742] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:12:48.050593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.054799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99138d-4355-4a24-bf9f-283d89f5b77e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.088126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.089495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.089769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.090039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.090677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:48.090981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.092343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.104406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 365/743] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:48.105244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.127174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.149330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6638a8-4301-4c90-8f54-9b0014e2da01 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.171429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.183263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.183860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.184130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.184395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.185070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.186406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.203647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 379/744] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:12:48 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:48.204449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.207059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aacc3-7887-4fd7-823d-547eacbca8f2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.253364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.253988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.254262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.254529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.255180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:48.255476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.256908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.270487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 366/745] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:48.271346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.339556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc8d6f-e137-409c-adaa-31a809e4a967 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.380640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.381178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.381452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.381720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.382367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.384346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.389435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb566-e304-4339-9380-cd67ae814ee7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.394443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.400982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 380/746] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:12:48 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:48.403515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.422862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.449179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.450121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.450553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.450973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.464551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.466442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:48.484083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:48.485150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:48.486094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:48.486094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:48.486094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:48.488335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 367/747] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:48.489497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.535651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6febdfd-c5ff-43ea-8a7f-776b4741d7c1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.578009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.578658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.578939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.579212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.588185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.590940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:48.605456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:48.606457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:48.607399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 381/748] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:48.608009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.614880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3d507-02bb-4b29-a705-8133f6f728c7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.653748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.654355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.654575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.655149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.663804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.665290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:48.678428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:48.679522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 368/749] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:48.680601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.681861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.733287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.746998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed3da-78b5-4770-8b57-568642801bc0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.791035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.792546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.792956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.793335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.794090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:48.794494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.795961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.815370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 382/750] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:48.816497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.831060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cb00c-52cf-49aa-89db-6d2f1227078d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.881394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.882787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.883220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.883640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.884656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:48.886217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.888367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.909018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 369/751] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:48.910055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.943144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba7b-46b7-4c31-a67d-fa8a8173df5c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.965855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:48.987338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.988095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.988474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.989133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.989886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:48.990197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.992447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.012988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.015834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 383/752] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:49.017024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.029765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5759f-c58a-49ad-9d5d-5b16714ebe3b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.074650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.075608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.076090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.076479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.085058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.087196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:49.103429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:49.105548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:49.106900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:49.108821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 370/753] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:49.111412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.148809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b595-425e-450b-8677-813d1f088815 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.191022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.191972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.192627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.193442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.248035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e9f5d-2381-4295-b6ea-98393a94aca6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.252222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.280068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.282627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.293893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.294992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.295279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.295558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.309492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.311191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:49.326872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:49.327843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:49.328752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:49.328752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:49.328752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:49.330841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 371/754] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:49.331951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.335832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.424679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 384/755] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:12:49.426120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.456860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e16b6-ab8f-43a2-a80f-60b692a167e8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.500675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.501671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.502166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.502653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.503550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:49.504050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.505683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.518857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 372/756] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:49.520140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.520918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.554234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fbf40-098c-40ac-b581-2ebede63612e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.595368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.595684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.596497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.596834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.597220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.597983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:49.598372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.600082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.617519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 385/757] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:49.618510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.646367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b7e34-dec7-4274-9eb4-d69f417babef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.688663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.689555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.689919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.690287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.701952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.703652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:49.720008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:49.721387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:49.722369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:49.722369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:49.722369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:49.725566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 373/758] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:49.727513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.754990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84887e79-e5fa-4d99-bb3f-32e5dba8be2e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.813252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.814416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.815392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.817252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.818708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=72e8f4cb893a4a119ffa520b2b7f6efc) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:49.819273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.820893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.824965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.830509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 386/759] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/role_assignments?user.id=72e8f4cb893a4a119ffa520b2b7f6efc&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:49.831515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.881143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fd601-288f-439c-92d2-261039cf5b5e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.897329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:49.942166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.943244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.944335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.945044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.957983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.960546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:49.982016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:49.982934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:49.983800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:49.996342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 374/760] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:50.001339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:50.028714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd136b-6087-4347-995b-45d243d5bdb1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.064707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.065331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.065748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.066025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.066674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:50.066982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.068407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.081448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 387/761] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:50.086787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:50.176358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7958c-a31f-4b73-ad52-eefd081b4396 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.180749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:50.249567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.251601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.251883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.252155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.252895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:50.253203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.254654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.260436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e79c31-7230-4810-8da1-25150a04702c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.274516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 375/762] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:50.281735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:50.336293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.336947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.337228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.337503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.340779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:50.352854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.355064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:50.375901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:50.376870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:50.377749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:50.381009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 388/763] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:12:50.388341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:50.444427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cff745-0e6b-48e5-839d-2592871d1203 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.487311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.488005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.488425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.488886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.491125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=00af7c59942242d5ba2517f2c1b07d9a, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.492674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456bb6-f19f-4e95-a2ff-3db47023bebb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.512234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 376/764] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:50 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:50.604983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9a46-f770-447c-aae2-d0ad1c748ab8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.605343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9a46-f770-447c-aae2-d0ad1c748ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.605565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed9a46-f770-447c-aae2-d0ad1c748ab8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.607925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 377/765] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:12:50.614588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60271ad-4de6-4a65-b585-313e356e875e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.614882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60271ad-4de6-4a65-b585-313e356e875e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.615145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60271ad-4de6-4a65-b585-313e356e875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.629261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746fbea-4a17-4c3d-814a-282f663eb0e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.638190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d60271ad-4de6-4a65-b585-313e356e875e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:50.644598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d60271ad-4de6-4a65-b585-313e356e875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:50.674642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:50.697554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.699444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.700018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.700303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.701065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:50.701378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.702830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.718464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 389/766] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:50.724707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:50.764604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 378/767] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:12:50.840861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b8c8-651a-4919-adf4-ba7e05e9faea None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:50.877063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:50.877668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.877947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.878220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.878950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=93e0aaed859841b6b45b2a98a59ef5f4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:50.879255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:50.880702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797b5dc-a703-4ae1-98f9-d5a1df1c2c0e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:50.886655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 390/768] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:50 2022] GET /identity/v3/role_assignments?user.id=93e0aaed859841b6b45b2a98a59ef5f4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:50.950711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccdb-64fe-45b1-99a1-2b33d9184f77 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.951172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccdb-64fe-45b1-99a1-2b33d9184f77 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.951548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccdb-64fe-45b1-99a1-2b33d9184f77 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.953410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 379/769] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:50.959211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:50.959628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:50.960005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:50.980431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:50.981740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:51.028128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:51.058304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfccdb-64fe-45b1-99a1-2b33d9184f77 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.058758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 391/770] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:51.085523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:51.191607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfccdb-64fe-45b1-99a1-2b33d9184f77 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.238179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:51.238811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:51.239145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:51.239419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] PATH_INFO: `/v3/services/network` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:51.240010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:51.241514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:51.253052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:51.254031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.254877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 380/771] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:51.262482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.380164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.404135 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65885e-845e-449a-96a3-4abcb03ff26f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.466270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:51.467256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:51.467765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:51.468224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:51.469141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:51.469637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:51.472443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:51.483688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 392/772] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:51.490854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.548973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:51.564994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:51.571408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0eb88-d87b-4684-9207-d6278e4c3a41 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.633336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:51.633891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:51.634165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:51.634429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:51.635024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:51.637101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:51.654232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:51.655295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:51.656419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 381/773] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:51.657968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef5952-86fb-4b4e-aef3-bbeaee0c1afd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.665452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.702942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:51.703549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:51.703822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:51.704088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:51.704744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:51.705186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:51.706664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:51.721880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 393/774] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:51.727726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:51.863339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a76f49-688b-45bc-b223-0517b9b2498e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.931151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459abf-de08-4a5a-a7e9-874bf6855ddc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:51.942106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:51.942716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:51.942991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:51.943259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:51.943891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:51.944188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:51.945846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:51.952956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:51.964750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 382/775] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:51.982433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:52.003211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:52.004183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.004713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.005187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.005386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:52.006303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] RBAC: Adding query filter params (interface=public, service_id=4e4c6a0c5e8f477786a51dc8567174a4, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:52.007015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:52.008249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:52.029826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 394/776] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/endpoints?service_id=4e4c6a0c5e8f477786a51dc8567174a4&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:52.038233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:52.110602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67d0d3-8fd7-4075-a2b9-b88f38f5561d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:52.190560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da953-5fe3-42b6-adec-d21369a565fb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:52.217874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:52.218502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.218792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.219268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.219689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:52.219994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:52.221398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:52.240304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 383/777] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:52.241662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:52.242506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.242954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.243389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.244199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:52.246421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:52.249654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:52.253006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 395/778] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:12:52 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:52.384946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:52.407338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a81cb-298b-4a99-900a-cf1f9228f362 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:52.450069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:52.450621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.450900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.451167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.451888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] RBAC: Adding query filter params (interface=public, service_id=cb0636b00d4f4bc7b14966375bfea54b, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:52.452200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:52.453624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66895f-0c00-48ae-9d75-23a7b6c483ab None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:52.463231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 384/779] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:12:52 2022] GET /identity/v3/endpoints?service_id=cb0636b00d4f4bc7b14966375bfea54b&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:52.468827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:52.504936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:52.578841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383440-ea2f-4060-81fb-5d2e0f0d9ddf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:52.615629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:52.616241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.616513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.616806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.617527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:52.618901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c44940-08b2-464e-a6d1-60fb73bc22ea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:52.624984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 396/780] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:12:52 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:52.699493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207030c-0a17-4919-89ec-2cabac9cf6a1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.699828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207030c-0a17-4919-89ec-2cabac9cf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.700035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207030c-0a17-4919-89ec-2cabac9cf6a1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.701927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 385/781] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:52.707101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:52.707389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:52.707660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:52.732500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:52.733725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:52.832073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 397/782] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:53.109727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207030c-0a17-4919-89ec-2cabac9cf6a1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:53.228191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207030c-0a17-4919-89ec-2cabac9cf6a1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:53.264199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:53.264885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.265167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.265428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.276755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6cff3f30-c51d-4858-a6fc-25dab4ac7787 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:53.282136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:53.283047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:53.284911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 386/783] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:53.289395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:53.301171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175ee1-d319-443a-bf20-e38289b919f9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.301519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175ee1-d319-443a-bf20-e38289b919f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.301686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175ee1-d319-443a-bf20-e38289b919f9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.304472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 387/784] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:53.313900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.314175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.314437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.326489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:53.333013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:53.344091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:53.348082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:53.476779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f55e-93dc-466e-af61-3757f5ca768d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:53.484955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 388/785] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:12:53.534889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:53.535543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.535822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.536092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.536829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:53.537139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:53.538499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ae358-449f-42c4-850a-630217e64d52 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:53.547837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 398/786] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:53.553757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:53.625964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8bc3-3119-4fd1-9405-4034f8df1541 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.626288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8bc3-3119-4fd1-9405-4034f8df1541 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.626523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8bc3-3119-4fd1-9405-4034f8df1541 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.628452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 399/787] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:53.634849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.635640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.635917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.665145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:53.666335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:53.693405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9f26d-a914-4e74-b3a6-3ea2a65cb63f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:53.759518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:53.760082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.760970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.761243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.763649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:53.783265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:53.785586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:53.802443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 400/788] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:53.803306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:53.804030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:53.804988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:53.806230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:53.806230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:53.806230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:53.806230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 389/789] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:53.811553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:53.823982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:53.915298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe96a4-de49-40ff-9cb6-77eb7657913e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:53.940269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ac769-8afa-4831-9373-cf97c00e002f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:53.969733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:53.970371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:53.970647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:53.970914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:53.997190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:54.002806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:54.005364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:54.007375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 401/790] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:54.013198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.013368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.013368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.013368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.013820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.014125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:54.014644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.015765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.041042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 390/791] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:54.045024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.140964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.165414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.196041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ab04c-64c1-4a47-b270-8b3e4818e512 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.196342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a2c7-7f39-4ed6-a8c6-d1d02fdda2f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.247171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.248092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.248637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.249113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.249976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:54.250084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.250609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.250731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.250911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.251186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.252682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.260608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.262769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 402/792] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:54.263700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.264129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:54.280872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:54.281854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 391/793] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:54.283428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.403346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad934a-20e5-4c4f-9772-395ea2f3cfb3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.408290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec72b3b-c3d7-41fb-b255-e6623854f810 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.421468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.450913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.451543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.451826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.452098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.452437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.453348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.453836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.454298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.460166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.467831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:54.468977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.470703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:54.473083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:54.474017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:12:54.475121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:54.479784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 403/794] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:54.480802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:54.493310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:54.494327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:54.495960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:54.495960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:54.495960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:54.499050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 392/795] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:54.500131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.614907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13dca0-8f21-4490-9adf-184a8f5d66e8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.617266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424215d5-325c-4136-8050-cf250b5f6249 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.653749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.654725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.655336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.655903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.656825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:54.657370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.659166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.661382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.662458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.662752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.663033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.663772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:54.664082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.665610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.671559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 393/796] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:54.672675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.691977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 404/797] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:54.693399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.703574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.755549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.802940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1057-54e1-4223-8e7b-85da9afbac6b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.815422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f89223-9882-49dd-a6c7-c0fa23b76858 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.842869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.843881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.844365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.844865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.845876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:54.846537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.848121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.859420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.860621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.860912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.861188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.869172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 394/798] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:54.870582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.873520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.876399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:54.898132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:54.899161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:54.900841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:54.900841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:54.900841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:54.904737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 405/799] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:54.905983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.971219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:54.994286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f852a-0827-4c44-8840-15b7ab13e6df None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.033831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.034460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.034744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.035019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.038243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ceda-915e-4f35-90b9-ff7d300055ed None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.046305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.047787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.048546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:55.063576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:55.064833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:55.065795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:55.065795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:55.065795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:55.065795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 395/800] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:55.066024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.082115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.082738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.083020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.083456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.091637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.093114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5be6c42d-9cb0-4e92-9e33-686d9288cb72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:55.105627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:55.106620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:55.107565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 406/801] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:55.108670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b6b1-4ec5-4ce5-a92d-d6034e072a70 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.108670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b6b1-4ec5-4ce5-a92d-d6034e072a70 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.108827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b6b1-4ec5-4ce5-a92d-d6034e072a70 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.114276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 407/802] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:55.114276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76b6b1-4ec5-4ce5-a92d-d6034e072a70 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.238143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76b6b1-4ec5-4ce5-a92d-d6034e072a70 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.279559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.280813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.281507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.281991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.283163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:55.283644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.285821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c090e19-30cb-4b27-bc93-66a5ed8d8e18 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.298755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33607a-e6d0-45ec-99a9-115856e558fc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.299692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 408/803] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:55.300953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e3c0-788e-47c8-b7ae-2036a462ac74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.301232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e3c0-788e-47c8-b7ae-2036a462ac74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.301504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e3c0-788e-47c8-b7ae-2036a462ac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.319436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9124e3c0-788e-47c8-b7ae-2036a462ac74 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:55.320660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9124e3c0-788e-47c8-b7ae-2036a462ac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:55.329812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.335193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.336171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.336453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.336748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.337387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:55.337687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.339226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.344546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.350742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 396/804] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:55.351531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.390222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 409/805] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:55.391281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72310-aaab-4191-b1ca-d2bc3c134652 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.391564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72310-aaab-4191-b1ca-d2bc3c134652 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.391829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b72310-aaab-4191-b1ca-d2bc3c134652 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.395066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 410/806] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:55.396033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b72310-aaab-4191-b1ca-d2bc3c134652 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.456803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143b01-8663-447b-90bc-3291e940b12c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.493309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.494189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.495169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.496082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.497083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:55.497636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.499239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.509055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b72310-aaab-4191-b1ca-d2bc3c134652 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.518017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 397/807] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:55.519111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.548926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.549549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.549822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.550087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.556837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.559005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1605056a-1a6f-4068-a6b4-d669c18a8f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:55.571476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:55.572619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 411/808] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.578915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.579562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.582343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.596814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:55.597992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:55.612693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.632945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df717-88dc-4c95-ac52-4cfdead22f62 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.667829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.668450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.668755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.669025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.669283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 412/809] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:55.670114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.676298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.677924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:55.690468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:55.691425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:55.692441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 398/810] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:55.693052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.792822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0195d-a651-4dfd-a94d-ea8c315a926d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.799810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1a6fc-eb83-49b8-b32a-2d0aceecfdfc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.812006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:55.841122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.841741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.842016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.842284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.842991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:55.843293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:55.844785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:55.858921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 399/811] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:55.859880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:55.944436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:55.945063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:55.945603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:55.945881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:55.964886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6be7-9ce8-4b09-90af-c92bed1eedce None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:55.966496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.002726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.003354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.003630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.004037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] PATH_INFO: `/v3/services/network` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.004466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.005864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:56.014882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:56.016022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.016931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 400/812] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:56.017709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.024295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.026300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.051246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.118915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ab0b4-0cf3-473a-adde-d42326957929 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.134554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 413/813] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:12:56.137481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.152763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.153364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.153635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.153906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.154624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.154922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.156328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.173655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 401/814] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:56.174288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.187674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.239784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58a411-b198-412a-ad81-6f4a766c1cb7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.267003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.273711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.274541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.274816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.275087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/72e8f4cb893a4a119ffa520b2b7f6efc/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.276186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89d491-ac6c-4de1-a28d-a7f5b3090a12 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.277118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=72e8f4cb893a4a119ffa520b2b7f6efc, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.278532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.290791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 414/815] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:56 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/72e8f4cb893a4a119ffa520b2b7f6efc/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:12:56.292078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.320536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.321144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.321407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.321681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.322282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.324027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:56.333778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:56.334858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.335746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 402/816] 10.222.0.71 () {56 vars in 1129 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:56.336571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.425069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026e504-3a82-4c37-8328-74713af0407f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.436484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.449322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cd1a1-9d91-4b2e-87f1-d54e4a666fe1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.470833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.471688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.472117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.472558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.473367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.473815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.475571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.482394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 415/817] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:56.483474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.490202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.490833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.491111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.491377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.502878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.504545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:56.519814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:56.520866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:56.521770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:56.521770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:56.521770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:56.524683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 403/818] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:56.525628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.537783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.594125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a1a49-189c-48b5-9e80-fb091c6e3925 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.627597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb1a8-d481-4015-ad19-b3c31244f243 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.630659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.631287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.631563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.631830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.643410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.645051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:56.661038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:56.661999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:56.662883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:56.662883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:56.662883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:56.662883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 416/819] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:56.662883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.664253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.666897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.666897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.666897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.666897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.666897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.668603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.675679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 404/820] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:56.676810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.695016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.752642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.784168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c78b24-f6e6-4210-b6bf-9a2d6be81ce7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.788860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a46f38-d8c9-41ff-841b-c19fc2805cf0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.823415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.824116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.824450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.824752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.825382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] RBAC: Adding query filter params (type=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.825678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.826527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.827102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.827198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.827394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.827663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.828311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.828637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.829993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.832630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 417/821] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:56.833558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.844379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 405/822] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:56.845173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:56.933728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.946999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27b86b-5b25-40e0-a95e-cebc76ac9604 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.953670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316961db-3a86-405b-9780-d12b2b786d02 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:56.984029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.984238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:56.984870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.985260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.985674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.986036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.986346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.988218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:56.990068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:56.990668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.990948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.991210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.991841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:56.992139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:56.993512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.002317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 418/823] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:57.003788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 406/824] 10.222.0.71 () {56 vars in 1124 bytes} [Mon Sep 19 11:12:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:57.004089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.004751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.106028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb78f-dcbe-41e0-97c4-889189a0ed92 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.112683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fa944-220d-4e8c-bb0a-bce7cb16e72f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.141409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.142323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.142771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.143204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.148404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.149030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.149308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.149577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.150238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.150825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.151721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.152649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:57.164424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:57.165541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:57.167256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:12:57.169259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 407/825] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:57.170360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.188652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 419/826] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:12:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:57.188652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.190695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:57.270075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:57.331541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237385c0-e3be-48c9-b652-ce64791991b2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.334710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba9764-def6-465b-8cf6-891963482e5a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.372386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.372982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.373262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.373568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.375237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.375839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.376113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.376388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.377139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.379397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.380686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.382238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:12:57.395550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:57.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 420/827] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:57.398106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.411092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 408/828] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:12:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:12:57.411939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.469809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:57.520158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e4479-0a53-4a91-a5be-15550a037f05 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.555555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30957-3d4f-403b-8fa0-b187edb04955 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.564052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.564698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.564996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.565245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.566435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:57.566435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.567818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.569802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:57.587081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 421/829] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:57.593841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.602147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.603256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.603850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.604460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.605408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:57.605919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.607740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.622843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 409/830] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:57.628730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.714204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe54a-e8a0-4df5-832a-3f2694df4bb8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.744012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:57.754785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80422f8a-0857-4fec-86d1-2b923d0a9e29 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.764151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.764777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.765053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.765807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.766545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:57.767227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.768947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03dc7f-47a2-48d7-b5b3-e32f195ea6c3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.777661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 422/831] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:12:57.797192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.797859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.798194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.798462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/93e0aaed859841b6b45b2a98a59ef5f4/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.817280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=93e0aaed859841b6b45b2a98a59ef5f4, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.818741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079234e8-7e7f-4ca4-aa85-8bdfd0f57058 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.835526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 410/832] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:12:57 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/93e0aaed859841b6b45b2a98a59ef5f4/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:12:58.528551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6765b-bf55-4290-836f-1687f61f614b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:58.528925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6765b-bf55-4290-836f-1687f61f614b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:58.529031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6765b-bf55-4290-836f-1687f61f614b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:58.530493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 423/833] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:58.535941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:58.536405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:58.536486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:58.555440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:58.556679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:58.570854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:58.632871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 411/834] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:12:58.902328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6765b-bf55-4290-836f-1687f61f614b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.008461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6765b-bf55-4290-836f-1687f61f614b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.044291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.044996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.045269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.045533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.056013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:12:59.061432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:59.062342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:59.063164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 424/835] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:59.070397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.177522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7185d8-2255-41b5-88f5-f601153b3a02 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.226539 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.227145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.227419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.227684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.228348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:59.228676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:59.230441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:59.239495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 412/836] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:59.246029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.294909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:59.353169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7a422-36cd-438d-966f-c543bf1e2c6b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.389825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.390441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.390713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.390981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.401285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:59.402704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:12:59.417765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:59.418688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:12:59.419567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:12:59.419567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:12:59.419567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:59.419567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 425/837] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:59.425968 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.441908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:59.535062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd645d-0101-421e-863a-222a738b50b3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.570295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.570950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.571162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.571414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.572054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:59.572349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:59.574308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb92662-2c8b-494b-bcd1-6cb40f662d6d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:59.588350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 413/838] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:59.597814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.703143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:59.710130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a781bf-28ea-4910-a03e-9a905949f7b8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.718596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ea0e-88e6-4f7f-bcaf-70afe79ca147 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.718880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ea0e-88e6-4f7f-bcaf-70afe79ca147 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.719141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63ea0e-88e6-4f7f-bcaf-70afe79ca147 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.720662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 414/839] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:59.726172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.726701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.727165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.746995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:59.749367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:59.752231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.752895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.753174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.753448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.764790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:59.766604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:12:59.782295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:12:59.783295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:12:59.784220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:12:59.786939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 426/840] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:12:59.796757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:59.838919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:59.846045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 415/841] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:12:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:12:59.910961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d7e55-a534-4cc3-8cdd-f4d585154062 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:59.949086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:59.949932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:59.950378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:59.950791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:59.951799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:12:59.952245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:59.953962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:59.974902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 427/842] 10.222.0.71 () {56 vars in 1135 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:59.981903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.113781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfd69c-6015-41c5-b2ce-8799b120951e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.152248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.153176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.153597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.154008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.160485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.180850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.244199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.247711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.249597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cca1c8-2d5d-4395-ba44-977f381890e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.298400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942cf9-4cac-4046-b387-23454f70b167 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.340472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.341132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.341408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.341678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.342264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.344013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dca26ba4-8fe8-4718-a34e-7cb97dfcd2b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:00.354432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:00.356089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:00.357001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 428/843] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:00.357794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574346-e94e-43ca-b319-a60bb9d79ace None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.357794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574346-e94e-43ca-b319-a60bb9d79ace None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.357794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574346-e94e-43ca-b319-a60bb9d79ace None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 429/844] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68781a-47ed-408a-963f-9757b357d01f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68781a-47ed-408a-963f-9757b357d01f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68781a-47ed-408a-963f-9757b357d01f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 430/845] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:00.362811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68781a-47ed-408a-963f-9757b357d01f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.372210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 416/846] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:12:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:00.374258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3081-b6ee-4611-a579-ed740874f8e9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.374258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3081-b6ee-4611-a579-ed740874f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.374258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3081-b6ee-4611-a579-ed740874f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.393163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e00a3081-b6ee-4611-a579-ed740874f8e9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:00.394350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e00a3081-b6ee-4611-a579-ed740874f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:00.451764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.469109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 417/847] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:00.470261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.470549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.470816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.482434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68781a-47ed-408a-963f-9757b357d01f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.493714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:00.495089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:00.522939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.523552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.523833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.523987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.524279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.525402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:00.526271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.527994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.533313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 431/848] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:00.534423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.584606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 418/849] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:00.584606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.682509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c5f8-c08a-4599-8cf4-4db1fa9329ea None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.700940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1af34-efc0-45c8-be0e-6e29a89954a9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.720364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.720995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.721375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.721661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.736527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.738111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.738396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.739005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.739276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.739540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.740207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:00.740440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.740543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.742316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.747832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 419/850] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:00.758528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:00.759823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:00.760897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:00.761795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:00.761795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:00.761795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:00.761795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 432/851] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:00.766937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.795331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:00.884621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae9883-43b5-4e25-8ef2-ceca3eab147d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.904093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962825ff-dc90-44f5-9243-e5671073d9b7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:00.924662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.925357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.925641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.925961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.926553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.927928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:00.937848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:00.938807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:00.940149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 420/852] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:00.941369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:00.944222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:00.944222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:00.944954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:00.944954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:00.945630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:00.945936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:00.947311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:00.961274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 433/853] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:00.962122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.029582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.041883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.056131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409427-8f6c-47d2-8056-831411824398 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.080598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932bd8-ad22-4f35-bf3c-cda785d67136 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.091992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.092741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.093018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.093285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.105610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:01.110906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:01.111827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:01.112712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 421/854] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:01.114094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.123858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.124531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.124838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.125115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.125731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.126014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.127411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.137026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 434/855] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.137660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.225036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4114-7c32-4e0f-b096-fe9db9451a44 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.249206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c79a2-0622-4043-80b4-b4f661978a60 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.260511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.261220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.261489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.261759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.268039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.269138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.270657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:01.282549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:01.283608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:01.284808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:01.288375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 422/856] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:01.289240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.290523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.291283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.292030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.292288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.292985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.293282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.295489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.300907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.311687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 435/857] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.311687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.396779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d038b-26a6-4a7c-87b5-8c7e1dacdb12 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.418550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a73f-fde9-4c31-a592-e5b3b865afcb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.431481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.432622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.432907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.433191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.433790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.434089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.435453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.440159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 423/858] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.440776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.469481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.470763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.471308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.472095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.473747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.474346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.477027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.497057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 436/859] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.497971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.532844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.545955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.572369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e974-d970-4cb2-b2a5-16ade2af1690 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.609758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fcaf2-234d-43cc-a774-6110a8859fce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.614111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.615409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.615884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.616347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.629258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.631009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:01.647668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:01.648671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:01.649552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:01.649552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:01.649552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:01.652627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 424/860] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:01.658817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.659052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=72e8f4cb893a4a119ffa520b2b7f6efc) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.659137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.666851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 437/861] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/role_assignments?user.id=72e8f4cb893a4a119ffa520b2b7f6efc&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.774941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a252-f089-4c3e-ad0d-424b81430173 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.800997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.812904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.813515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.813792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.814113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.814764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:01.815111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.816729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.831482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 425/862] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:01.837379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.957918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e8cc-b799-49d5-9f27-48e5417b78e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.961124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.993851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.995024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.995378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.995839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:02.003954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:02.005408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:02.017469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:02.018438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:02.019420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 438/863] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:02.024721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:02.132805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbe06e-a86c-4420-9916-3c76b72a7798 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:02.173736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:02.174692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:02.175200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:02.175687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:02.176645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:02.177151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:02.178775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:02.203129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 426/864] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:13:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:02.214576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:02.320911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105208aa-a45b-4b86-8f11-5c3d2efb940c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:02.359852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:02.360499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:02.360815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:02.361086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:02.393305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:02.433492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:02.434988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:02.541036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 439/865] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:02.547424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:02.613573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:02.668507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231118b-c0d2-43a7-90f3-5e1b10a04f14 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:02.707521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:02.708142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:02.708416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:02.708726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:02.719022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:02.720534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:02.735850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:02.736973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:02.737940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:02.737940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:02.737940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:02.737940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 427/866] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:02.744169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:02.806596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:02.847722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ee47-ac94-4250-8f30-00efa922f9ac None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:02.882839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:02.883447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:02.883727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:02.883998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:02.884686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:02.885089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:02.886543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d62cc-1721-4e45-86fe-cc3c7f275138 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:02.900029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 440/867] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:02.906512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:03.010246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:03.020818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331d7c-23fc-47d7-a115-4a69dbfebcb1 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:03.021361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e72-3a01-4f7c-877b-6e827cc42c6c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.022177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e72-3a01-4f7c-877b-6e827cc42c6c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.022746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e72-3a01-4f7c-877b-6e827cc42c6c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.024284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 441/868] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:03.030627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.030913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.031186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.052515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:03.053716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:03.061015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:03.061918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.062404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.062923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.070418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:03.072193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:03.085626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:03.086532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:03.087430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:03.090454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 428/869] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:03.096202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:03.140660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 442/870] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:03.212640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c62c-9842-4a2b-a515-248a61470227 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:03.245982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:03.246862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.247296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.247727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.248558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:03.249058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:03.250680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:03.264091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 429/871] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:03.269804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:03.323859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:03.368907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5443c0-a067-4978-9086-62daa53cb5c2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:03.403566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:03.404166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.404438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.404736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.405461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=93e0aaed859841b6b45b2a98a59ef5f4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:03.405760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:03.407169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5281c-8b6c-4c00-842e-5f4daa5876ec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:03.413566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 443/872] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:03 2022] GET /identity/v3/role_assignments?user.id=93e0aaed859841b6b45b2a98a59ef5f4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:03.442245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:03.459906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:03.558839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ef5b7-fb32-44fd-9bb3-a0a4218a260e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:03.596381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:03.597020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.597297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.597566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.598214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:03.599810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23790df-8b47-4856-862e-c862fb7cc20d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:03.624689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 430/873] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:03 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:03.806441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658bc4-16d0-47ef-8c5f-e1fe0a371fec None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.806755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658bc4-16d0-47ef-8c5f-e1fe0a371fec None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.807067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658bc4-16d0-47ef-8c5f-e1fe0a371fec None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.808516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 444/874] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:03.813697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65813119-5706-4453-80af-a1761ece8d4b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.814148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65813119-5706-4453-80af-a1761ece8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.814236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65813119-5706-4453-80af-a1761ece8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.833841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-65813119-5706-4453-80af-a1761ece8d4b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:03.835363 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-65813119-5706-4453-80af-a1761ece8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:03.911679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:03.921353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 431/875] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:04.038511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719947d9-b332-4899-9fc1-941325e2ff6b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.039068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719947d9-b332-4899-9fc1-941325e2ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.039068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719947d9-b332-4899-9fc1-941325e2ff6b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.040663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 445/876] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:04.046914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.047211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.047483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.066508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:04.067628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:04.139761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 432/877] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:04.222487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719947d9-b332-4899-9fc1-941325e2ff6b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:04.326128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719947d9-b332-4899-9fc1-941325e2ff6b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:04.344085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:04.361569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:04.362164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.362436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.362701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.363348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:04.364712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:04.381244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 446/878] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:04 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:04.427682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:04.550378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddf795-927a-40ae-af11-51524c819e62 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:04.581670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:04.594290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:04.594916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.595192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.595457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.596031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:04.597409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:04.606849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:04.607864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:04.608956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 433/879] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:04.616342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:04.723874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee852-2b21-439b-894f-fcc2c97707ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:04.757743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:04.758339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.758615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.758881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.759497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:04.759793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:04.761833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c45a85-4c7e-4025-9c4d-8bda0dbc3695 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:04.766731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 447/880] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:04.772536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:04.881264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c959-7dd0-49b6-af10-b8fe7d0b6610 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:04.918342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:04.919355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.919826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.920292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.921144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:04.921650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:04.923363 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a6fc-2749-4cbf-81c5-13cf68dabc14 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:04.932700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 434/881] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:05.815718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bab07-6ca1-4b7e-ab26-63aed21145cb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:05.816490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bab07-6ca1-4b7e-ab26-63aed21145cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:05.816490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bab07-6ca1-4b7e-ab26-63aed21145cb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:05.818417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 448/882] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:05.825107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001841-a0c2-4dca-9e17-943fa38e599b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:05.825502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001841-a0c2-4dca-9e17-943fa38e599b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:05.825715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001841-a0c2-4dca-9e17-943fa38e599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:05.850067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-64001841-a0c2-4dca-9e17-943fa38e599b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:05.851264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-64001841-a0c2-4dca-9e17-943fa38e599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:05.903585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:05.923143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 435/883] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:05.925700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae472-ef00-4872-9b8e-9e167368dd76 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:05.925989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae472-ef00-4872-9b8e-9e167368dd76 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:05.926266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae472-ef00-4872-9b8e-9e167368dd76 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:05.927812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 449/884] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:05.933389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:05.933680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:05.933957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:05.958097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:05.959297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:06.027582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 436/885] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:06.219682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae472-ef00-4872-9b8e-9e167368dd76 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.267263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:06.303686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.331970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae472-ef00-4872-9b8e-9e167368dd76 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.376235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.377160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.377442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.377716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.392148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:06.398452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:06.399385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:06.400209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:06.401594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 450/886] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:06.407459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.428712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8236b78-3514-4cb1-ad34-88b7caf4e40d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.444322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:06.469076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.469839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.470118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.470387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.471269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.472655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:06.485762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:06.487158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:06.488371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 437/887] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:06.492707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.536660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b756-3000-4390-843d-25e30925dc14 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.538332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:06.582963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.584118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.584555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.584996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.585977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:06.587197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.589368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:06.600163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 451/888] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:06.607303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.627666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82505-44dd-400b-bbb5-f71265531744 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.664705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.665424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.665708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.665983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.667232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:06.667528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.670863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:06.680749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 438/889] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:06.681824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.730343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:06.739621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175d8c5-23fe-475a-b693-b5c908a5e8ad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.787471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.788653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.789136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.789661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.804460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a760-fd2f-4efb-8513-17f687774916 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.805813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.807615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:06.825325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:06.826770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:06.827661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:06.827661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:06.827661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:06.831280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 452/890] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:06.832145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.853546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:06.858082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.859609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.860869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.861377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.862591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:06.863625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.865814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf0e3-3ee3-48a0-a230-bdf8a86ee747 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:06.874179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 439/891] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:06.878204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b805-a880-4663-b4a3-ec99a65261a3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.878497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b805-a880-4663-b4a3-ec99a65261a3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.878850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b805-a880-4663-b4a3-ec99a65261a3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.880247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 440/892] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:06.884523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b805-a880-4663-b4a3-ec99a65261a3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:06.950131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea0ae-734c-4b6f-86e0-b37c58f2ea17 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:06.985107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:06.985625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:06.985901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:06.986171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:06.986807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:06.987110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:06.988459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68493849-e231-4fde-b6b3-6617c8dcd053 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.000741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b805-a880-4663-b4a3-ec99a65261a3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.005735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 453/893] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:07.005735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.005735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.005735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.013173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.024477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:07.025813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:07.047807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.048431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.048970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.049095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.049753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] RBAC: Adding query filter params (interface=public, service_id=e3f6c39bcfb949818432c785b40233f7, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:07.050061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.051477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.057837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 441/894] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:13:06 2022] GET /identity/v3/endpoints?service_id=e3f6c39bcfb949818432c785b40233f7&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:07.058516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.109884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 454/895] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:07.111092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.126036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.178501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d1d72-12db-452b-9cef-da59afb990a5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.219813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.220526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.220901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.221181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.227441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d93b-85d9-44de-88a9-91735715226f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.229170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.230621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-acadb783-111d-4bd1-a28e-dfc80c52f169 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:07.242671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:07.243651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:07.245170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 442/896] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:07.246351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43107-3c8a-4bcb-8941-55aabccc0cb2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.246351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43107-3c8a-4bcb-8941-55aabccc0cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.246506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca43107-3c8a-4bcb-8941-55aabccc0cb2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.247819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 443/897] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:07.252752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca43107-3c8a-4bcb-8941-55aabccc0cb2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.269867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.270472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.270753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.271011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.271608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.272984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d4936-ced7-4057-b907-e0abc95511fd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.279729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 455/898] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:13:07.280738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.281017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.281285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.300999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.301664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:07.302795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:07.381592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.396607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 456/899] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:07.396607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.396930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca43107-3c8a-4bcb-8941-55aabccc0cb2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.431346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.432209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.432965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.433246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.434292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:07.434668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.436980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.465837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 444/900] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:07.471434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.521780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f7fe9-da5e-44e3-9720-c16967095e00 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.565201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.565831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.566106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.566369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.566949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.568560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.573746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:07.581635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:07.582606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:07.589108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 457/901] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:07.591490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.591735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de574-6909-467d-bf3b-aee6aaac9a69 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.628380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.629126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.629405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.629672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.675032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.704915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.706359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.717568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef1b4-f74d-445a-b589-5633a10aad57 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.753797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.754398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.754680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.754955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.755584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:07.755886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.757319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.762443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 458/902] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:07.763198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.808558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.823685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 445/903] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:13:07.824600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.880613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac13036-2e2c-4f19-9110-c9093cff82f8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.914330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:07.923974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.924606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.924900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.925151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:07.926039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:07.927157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:07.932333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc99-d8e8-4b5f-afe0-bd2135603256 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:07.942932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 459/904] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:07 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:07.943840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:07.997942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:07.998648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:07.998989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:07.999343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.000048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:08.000413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.002003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.015432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 446/905] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:08.021198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.092524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43777c5-63fc-4f31-9dd3-c80ac4179998 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.100895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:08.137066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.137825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.138177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.138442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.150337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.152765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:08.168438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:08.169698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:08.171034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:08.171034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:08.171034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:08.171034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 460/906] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:08.175335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.175955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495244e2-a998-4f33-888d-8b9c47ac2ddd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.225801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.226433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.226712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.226980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.227231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:08.227782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] RBAC: Adding query filter params (interface=public, service_id=b5bec0e8f13f46df9b727ada3fc45def, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:08.227985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.230033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.235577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 447/907] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/endpoints?service_id=b5bec0e8f13f46df9b727ada3fc45def&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:08.241175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.301691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bdcf8-1ce3-4f3c-b08b-70591345fb3f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.346949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.347922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.348404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.348894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.350005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e3a2-3cef-46ab-ae73-1b5711500690 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.350271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:08.350773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.353136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.370326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 461/908] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:08.373014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:08.378457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.396431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.398018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.398607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.399083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.400130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.402150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.411277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 448/909] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:13:08.500683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:08.504536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d8e8-9ce1-42f5-b950-7e37c282256d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.543513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.544151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.544425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.544725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.553001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.554444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:08.568317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:08.569351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:08.570996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 462/910] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:08.576093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.685207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b67a1f-a8b4-48d9-a434-a0c3d6f1075a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.721774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.722707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.723168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.723672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.724856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:08.725346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.727008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc348-6bc6-4431-a63d-8c41d8ce31f3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.740648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 449/911] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:08.747121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:08.853787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff6b-1dc1-40fc-8635-3a11fc7f173b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:08.888976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:08.890573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:08.891027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:08.891493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:08.892395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] RBAC: Adding query filter params (role.id=f04542c7061349d39fd80a7c0b7c6d68, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=93e0aaed859841b6b45b2a98a59ef5f4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:08.892957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:08.894631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966b2e-e9ad-449d-8f03-ecb530611f86 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:08.902148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 463/912] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:08 2022] GET /identity/v3/role_assignments?user.id=93e0aaed859841b6b45b2a98a59ef5f4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=f04542c7061349d39fd80a7c0b7c6d68 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:09.638336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07bee-48c3-4227-9fd9-2dd0a86cdc9c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:09.638888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07bee-48c3-4227-9fd9-2dd0a86cdc9c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:09.638888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07bee-48c3-4227-9fd9-2dd0a86cdc9c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:09.640201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 450/913] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:09.645790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628ba-2145-4995-92ab-2e5e59982f29 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:09.646076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628ba-2145-4995-92ab-2e5e59982f29 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:09.646349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628ba-2145-4995-92ab-2e5e59982f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:09.665551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-026628ba-2145-4995-92ab-2e5e59982f29 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:09.667059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-026628ba-2145-4995-92ab-2e5e59982f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:09.686332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:09.741659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 464/914] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:10.019475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07bee-48c3-4227-9fd9-2dd0a86cdc9c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.059864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:10.143984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07bee-48c3-4227-9fd9-2dd0a86cdc9c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:10.182258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:10.183247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.183692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.184111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.184874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:10.186393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:10.195894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:10.197100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:13:10.198510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:10.200890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 451/915] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:10.204190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043e85-5fc9-4562-8a42-2bf5dae1e197 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.204686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043e85-5fc9-4562-8a42-2bf5dae1e197 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.204773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043e85-5fc9-4562-8a42-2bf5dae1e197 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.208192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 465/916] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:10.212346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.212457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.212457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.212457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.232920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:10.234099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:10.313751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 466/917] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:10.339803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:10.343503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a451-7dd2-4fff-a52f-e4a4624659a7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:10.381733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:10.382336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.382612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.382881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.383508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:10.383808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:10.386405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:10.391525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 452/918] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:10.397204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.486061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:10.502868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77539a-8ae1-4ffd-82ef-2bfa3c641dea None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:10.539286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:10.539889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.540169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.540439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.541152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:10.542106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:10.543475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:10.548732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 467/919] 10.222.0.71 () {56 vars in 1114 bytes} [Mon Sep 19 11:13:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:10.554407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.586109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.685364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c81-dd86-428f-8542-6d6f5c9afb9f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:10.719351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65592-7cf3-415e-ad80-a9c7ba831445 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:10.723692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:10.724418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.725003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.725277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.725954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:10.727328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae510412-41f5-49fd-8983-037a8a013b91 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:10.756776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 453/920] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:10.758315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23513cc-5c51-4974-9cc4-be82465b1382 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.758602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23513cc-5c51-4974-9cc4-be82465b1382 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.758967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23513cc-5c51-4974-9cc4-be82465b1382 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.761433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 454/921] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:10.767268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.767578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.767827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.777770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:10.778559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:10.779038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:10.779399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:10.780092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:10.781680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:10.790785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:10.792296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:10.793506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:10.794349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:10.795794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:10.799600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 468/922] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:10.801374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:10.823711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:10.833119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:10.933467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 455/923] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:11.030496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f359b-30bd-4b7b-a041-30634482ab87 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.074304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.074912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.075189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.075458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.076098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:11.076398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.077809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dfa77-0028-4f13-92c1-6888e1380939 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.084039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 469/924] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:11.090899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.156520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190facee-a427-405f-8b99-89dab8e51c1e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.157566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190facee-a427-405f-8b99-89dab8e51c1e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.157566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190facee-a427-405f-8b99-89dab8e51c1e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.164033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 470/925] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:11.165993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.166337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.167545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.197957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:11.200119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:11.243195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea8cf3-fbe9-4cac-bb5d-a7e48d28d4ad None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.294576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 471/926] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:11.295250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.297538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:11.301104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.301722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.301995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.302259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.302894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:11.303192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.306273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.310417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 456/927] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:11.315789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.339764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:11.413936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd6c08-32cc-4d24-a520-5e0ef6af98b0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.447112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c64dd-2bbc-45ec-be60-da1ade037df3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.469046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.469822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.470174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.470511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.471173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.472694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:11.484394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:11.485646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:13:11.486771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:11.492859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 472/928] 10.222.0.71 () {56 vars in 1132 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:11.495598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.501812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.502419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.502695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.502966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.503667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] RBAC: Adding query filter params (interface=public, service_id=0927cd832a1f43e48b07b0c753994dd5, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:11.503971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.505371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.516718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 457/929] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/endpoints?service_id=0927cd832a1f43e48b07b0c753994dd5&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:11.517588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.573767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:11.601596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:11.612854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2499-c5d9-4d4e-8fa9-71aad65e99a9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.626029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa390-780c-4109-9aa8-e46a5617268b None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.649764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.650371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.650820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.651101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.651726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:11.652033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.653426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.658657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 473/930] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:11.659437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.669757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.670721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.671505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.671976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.673116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.674689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.681196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 458/931] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:13:11.693774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.801320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34669b1-3415-4c59-87a7-68a1a8b0dd14 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.825282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44c82-3c92-48bf-af4d-32db634f3740 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:11.841575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:11.849458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.850544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.850952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.851326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.866688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:11.873160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:11.874388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:11.875440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:11.881796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 474/932] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:11.883369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:11.883369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:11.883369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:11.883647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:11.884235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:11.884550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:11.886213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.886571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:11.898042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 459/933] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:11.899560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:11.909714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:12.023230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57389790-9d66-40f9-a1aa-7897103247a1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.026440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20a6d-cb48-4cd4-8792-440ab02a1934 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.066489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.067379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.067894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.068404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.069348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.070926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.071126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.071714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.072087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.073177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.074462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:12.074966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.076626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.092351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 475/934] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:12.097506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:12.112799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 460/935] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:12.169043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:12.222168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385b08-256a-4ed6-81c5-73e3fb114bf3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.269096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.269912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.270289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.270657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.283386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.285033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:12.301623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:12.303176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:12.304250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:12.304250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:12.304250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:12.306121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 476/936] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:12.311126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:12.380328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:12.426906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7780a-8118-4b95-87eb-b37c4a50ccd0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.464853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.465611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.466007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.466373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.467118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:12.467517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.469068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.482866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 461/937] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:12.488543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:12.590660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:12.593695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608ad2-c394-4d77-b05d-44b571cd02a6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.629559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.630179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.630505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.630718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.639462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.640981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:12.654430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:12.655642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:12.656909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 477/938] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:13:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:12.663372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:12.770243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61d9e0-ca48-46c8-97d5-924fdcabacae None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.795661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:12.808517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.809246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.809525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.809798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.810531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:12.810836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.812272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:12.831424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 462/939] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:13:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:12.837267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:12.946784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14e3fd-ca9d-4ea2-8ba4-502aa13e0b51 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:12.982253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:12.982878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:12.983151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:12.983416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:12.994400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:12.995907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:13.011042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:13.011997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:13.013187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:13.013187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:13.013187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.013187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 478/940] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:13.019394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.127944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ddf3-568d-4492-9cef-7ccde95dac32 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:13.171452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:13.172086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.172364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.172669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.173337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:13.173638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:13.175128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0a98-c7e6-4c8f-92d6-6b364711e349 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.189080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 463/941] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:13.194838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.225255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:13.277433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e2dd-d78a-4081-8f2b-66b9710e37be None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.277759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e2dd-d78a-4081-8f2b-66b9710e37be None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.277981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01e2dd-d78a-4081-8f2b-66b9710e37be None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.280771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 464/942] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:13.284820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71984f9-6545-4971-b188-3d9444db151a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.285101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71984f9-6545-4971-b188-3d9444db151a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.285372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71984f9-6545-4971-b188-3d9444db151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.304887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e71984f9-6545-4971-b188-3d9444db151a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:13.306157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e71984f9-6545-4971-b188-3d9444db151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:13.315907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2bdc-e687-4b8b-9fac-ef3481b0a1d1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:13.343371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:13.355810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:13.356489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.356786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.357059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.364107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:13.365635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:13.377235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:13.378130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:13.378997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.380656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 479/943] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:13.384661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.392716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 465/944] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:13.456073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:13.490937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99edb9-da0d-48b8-b9b3-f190b807bcda None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:13.528531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:13.529157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.529436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.529703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.530394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:13.530699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:13.532115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.545270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 480/945] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:13.551166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71984f9-6545-4971-b188-3d9444db151a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.654058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71984f9-6545-4971-b188-3d9444db151a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:13.687213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.688954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:13.689619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.689960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.690242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/93e0aaed859841b6b45b2a98a59ef5f4/roles/f04542c7061349d39fd80a7c0b7c6d68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.692624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=93e0aaed859841b6b45b2a98a59ef5f4, role_id=f04542c7061349d39fd80a7c0b7c6d68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:13.694070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.712676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 466/946] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:13:13 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/93e0aaed859841b6b45b2a98a59ef5f4/roles/f04542c7061349d39fd80a7c0b7c6d68 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:13:13.798443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8393b-d1c9-46d2-a972-5cc90efec901 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:13.831295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:13.836985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:13.837586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:13.837864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:13.838249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:13.839000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:13.840450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:13.843447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING keystone.server.flask.common [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:13:13.864288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:13:13.864288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:13:13.864288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [parameters: {'id': 'f27ac17f2a944a48b96cbbd13f949f2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:13:13.864288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-00c075f3-d92d-4c3d-9372-7aeeeeb8efe4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f27ac17f2a944a48b96cbbd13f949f2a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f27ac17f2a944a48b96cbbd13f949f2a. Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:13:13.881793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 11:13:13.882704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Sep 19 11:13:13.883670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:13:13.886454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:13:13.888669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:13:13.890888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'id': 'f27ac17f2a944a48b96cbbd13f949f2a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.893036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:13.902991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f27ac17f2a944a48b96cbbd13f949f2a. Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:13.904903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 481/947] 10.222.0.71 () {60 vars in 1140 bytes} [Mon Sep 19 11:13:13 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:13.905981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:13.931264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:14.007228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e39ce-90fb-4557-a746-5a6c0ccd3d79 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:14.032515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008abce9-0b32-404b-ad84-55bb755ccd7d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.033061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008abce9-0b32-404b-ad84-55bb755ccd7d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.033572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008abce9-0b32-404b-ad84-55bb755ccd7d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.038271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 482/948] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:14.044801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.045094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.045365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.045659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:14.046308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.046582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.047504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.055399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:14.057091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:14.065124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:14.066649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:14.071492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:14.072813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:14.073798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 467/949] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:14.078829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.142540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 483/950] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:14.187695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:14.197293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6095a7-7c0e-44da-a624-acdd7828d215 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:14.235069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:14.235725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.236006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.236275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.236966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:14.237268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:14.238762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4829f-8e2b-40de-8e6d-a072c069bcef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:14.256621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 468/951] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:14.424058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.516780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc9-db12-42fb-88fa-7f0efb74000e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.517118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc9-db12-42fb-88fa-7f0efb74000e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.517326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b7bc9-db12-42fb-88fa-7f0efb74000e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.519515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 469/952] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:14.524065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.524377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.524682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.534542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8a4d5-6c5d-436d-af7c-ed54b4d7c890 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:14.545958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:14.547144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:14.555026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:14.581275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:14.581907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.582183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.582449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.583300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:14.585559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:14.597043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:14.598311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:14.599244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 484/953] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:14.605458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.636569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 470/954] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:14.727803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9bce-4d15-42fc-ac46-a9a0107622ce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:14.767174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:14.768163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.768713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.769206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.770056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:14.770571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:14.772123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:14.778725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 485/955] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:14.788642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.870468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:14.890473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bff7-7dbf-4d9c-a991-ff29c454ebb4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:14.925797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.926884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:14.927489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:14.927764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:14.928039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:14.928703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:14.929003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:14.930364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:14.935926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 471/956] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:14.942111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:14.988779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:15.052694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cd7a-f956-4a8e-9b52-9ca97077cf27 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:15.073171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd500b-cb46-48cc-aa33-e7c969aa2eb6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:15.090586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:15.091275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:15.091555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:15.091820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:15.092400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:15.093971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:15.105205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:15.106247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:15.107086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 486/957] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:15.112326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:15.132211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:15.133470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:15.134344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:15.134870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:15.135866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:15.138190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:15.160323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:15.172750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 472/958] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:15.234127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54408a8d-4041-4370-8342-82dc0aeb1597 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:15.248105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:15.287054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:15.288082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:15.288570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:15.289081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:15.290064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:15.290592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:15.293401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47325c16-19a4-4cf5-b7e9-bb0a2e19ff7a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:15.299976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 487/959] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:15.308828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:15.418851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9289021-4120-4caa-90dd-5b34ff3e456f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:15.454565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:15.455177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:15.455455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:15.455727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:15.456398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:15.456730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:15.458099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b7bc-5216-4b19-8b0b-f0da5447f385 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:15.463237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 473/960] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:16.077339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e601bc-0b7e-44a3-82e5-0f34bca554d5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.077931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e601bc-0b7e-44a3-82e5-0f34bca554d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.077931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e601bc-0b7e-44a3-82e5-0f34bca554d5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.079487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 488/961] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:16.084705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222d09-8faf-4a32-9583-6b564290f44a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.085525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222d09-8faf-4a32-9583-6b564290f44a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.085994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222d09-8faf-4a32-9583-6b564290f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.105401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-00222d09-8faf-4a32-9583-6b564290f44a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:16.106906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-00222d09-8faf-4a32-9583-6b564290f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:16.170421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:16.180532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 474/962] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:16.455171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e601bc-0b7e-44a3-82e5-0f34bca554d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:16.566591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e601bc-0b7e-44a3-82e5-0f34bca554d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:16.606903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70e2b-4f21-4914-abf6-e28dab18ae07 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.607096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:16.607216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70e2b-4f21-4914-abf6-e28dab18ae07 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.607487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70e2b-4f21-4914-abf6-e28dab18ae07 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.607585 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.607786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.608064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.610193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 475/963] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:16.614156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.614432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.614697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.621195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:16.627658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:16.628606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:16.629449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 489/964] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:16.633584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:16.635482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:16.637652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:16.671425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:16.712353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 476/965] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:16.750039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d24c4-0ad9-4065-bdf0-b26a132a03a0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:16.785502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:16.786335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.786756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.787200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.787994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:16.788439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:16.789944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:16.798725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 490/966] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:16.804523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:16.908728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461599a-5100-47b8-9d12-bbfec931125c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:16.933304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:16.944882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:16.945774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:16.946346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:16.946785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:16.957104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:16.958703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:16.973986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:16.975379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:16.976479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:16.976479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:16.976479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:16.978218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 477/967] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:16.983969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:16.993614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.092039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.101113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6648d-e501-4450-920a-c8d3f19f0e23 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.120352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b5748-32fd-48bb-91ff-6acb0d925cf0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.149670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.150274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.150591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.150863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.151489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:17.151792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.153168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.162152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.162995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.163414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.163828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.164631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.166304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.169175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING keystone.server.flask.common [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:13:17.172608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 491/968] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:17.175632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.187160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.sql.core [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:13:17.187160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:13:17.187160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [parameters: {'user_id': 'b4a31b96571e456f90f1f599d7c4da62', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:13:17.187160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81386) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 19 11:13:17.194841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:13:17.195747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application yield resource Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise self.value Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application session.commit() Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:13:17.197033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:13:17.199652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:13:17.201557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application result.read() Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:13:17.203237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b4a31b96571e456f90f1f599d7c4da62', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:17.204983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 11:13:17.207787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:13:17.209972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.210756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 478/969] 10.222.0.71 () {60 vars in 1131 bytes} [Mon Sep 19 11:13:16 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:17.216385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.309148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.313635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8b67-461e-43b6-8ef8-db1fd570147b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.348164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56dbfa-91b2-477b-bb16-6cd367da98f8 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.356136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.357233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.357749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.358211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.367990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.370401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:17.384532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:17.385556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:13:17.386590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:17.393965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 492/970] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:17.395091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.396650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.397436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.397807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.398176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.413861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.414716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.418410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:17.438168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:17.439255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:13:17.440182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:17.444696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 479/971] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:17.447075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.517093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aca90f-91fa-4c5f-b418-e327b8ddc342 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.556184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.557204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.557683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.558146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.559548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:17.560030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.562122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc231602-c1d0-4b09-9c36-c91e29335bb9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.567560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.571841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136bc1-2e67-4f96-abd3-f39f3d990e92 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.583260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 493/972] 10.222.0.71 () {56 vars in 1149 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:17.584655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56301c-d8dd-4e12-bcff-33a4362128cb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.584937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56301c-d8dd-4e12-bcff-33a4362128cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.585200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56301c-d8dd-4e12-bcff-33a4362128cb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.586552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 494/973] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:17.589298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56301c-d8dd-4e12-bcff-33a4362128cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:17.617102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.617759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.618041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.618313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.619043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:17.619383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.620874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb260-21dc-41d4-9207-03237f19a109 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.680622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 480/974] 10.222.0.71 () {56 vars in 1101 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:17.680622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf652-fb89-4304-baff-7cf282471253 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.680622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf652-fb89-4304-baff-7cf282471253 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.680622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf652-fb89-4304-baff-7cf282471253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.682812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.699926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2aeaf652-fb89-4304-baff-7cf282471253 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:17.701504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2aeaf652-fb89-4304-baff-7cf282471253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:17.728205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56301c-d8dd-4e12-bcff-33a4362128cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:17.767970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:17.768610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.768892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.769162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.776890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 481/975] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:17.778459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330262b-36fe-47da-b1a4-29b025da6ed8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.778889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330262b-36fe-47da-b1a4-29b025da6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.779301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330262b-36fe-47da-b1a4-29b025da6ed8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.781119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 482/976] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:17.786527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:17.786810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:17.787084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:17.809738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:17.810883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:17.865385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:17.866908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:17.904527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 483/977] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:17.951726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:17.986697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 495/978] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:17.991893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.015608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.071670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.110134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc2fd5-6712-466d-ba3b-00a060caefe5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.147146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.147776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.148037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.148293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.158807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.160326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:18.176073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:18.177085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:18.177990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:18.177990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:18.177990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:18.178161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb140b-3caa-44dc-86ff-a672dc8feae2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.178588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 484/979] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:18.181669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.219949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.220560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.220863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.221128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.221709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.223047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:18.233243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:18.234532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:18.235361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 496/980] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:18.236153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.252273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.270363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.287467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6f3f0-ff62-482d-9063-6e4fdd2fbae0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.321831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.322409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.322840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.323040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.323681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.325082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.338264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1306-e0a3-474a-af32-2ffe6e8cedfe None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.340162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 485/981] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:18 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:18.341012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.385942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.386996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.387461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.387914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.388789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.389273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.390887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.405579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 497/982] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:18.410916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.458320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcb8df-b96f-4ec5-8c1d-7fbe259c0c2c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.489267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.498741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.499564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.499843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.500503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.501536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.502442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.504216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.511434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 486/983] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:18.516348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.518202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.531754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2eb4d-db38-44bd-ab12-c27b71196216 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.569852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.570591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.570873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.571121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.578691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.580167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:18.592963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:18.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:18.594836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 498/984] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:18.600137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.633731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b994c4-cc05-44f3-bc8c-7ff54af9d044 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.669639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.670241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.670517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.670783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.671461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.671762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.673184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.683511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 487/985] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:18.684986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.708983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab7c0-ce76-4c02-8ab0-1a8aede85cf5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.742746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.743383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.743622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.743875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.745104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.745404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.746363 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.746810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.764271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 499/986] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:18.766397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.779107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:18.803159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab441b7-8836-4a7a-8e36-37035be7c00e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.843883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.844405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.844711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.844984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.845680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] RBAC: Adding query filter params (interface=admin, service_id=0927cd832a1f43e48b07b0c753994dd5, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.845985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.847414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.852851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 488/987] 10.222.0.71 () {56 vars in 1249 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/endpoints?service_id=0927cd832a1f43e48b07b0c753994dd5&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:18.858862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:18.881361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554976f-52e4-4510-9bdb-8aa3caaf88fc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.918664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:18.920036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:18.920636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:18.921166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:18.922070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] RBAC: Adding query filter params (role.id=f04542c7061349d39fd80a7c0b7c6d68, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=93e0aaed859841b6b45b2a98a59ef5f4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:18.922539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:18.924108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1783c-3b8b-45f5-bea0-0d6b93c658da None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:18.939749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 500/988] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/role_assignments?user.id=93e0aaed859841b6b45b2a98a59ef5f4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=f04542c7061349d39fd80a7c0b7c6d68 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:18.967725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c90aa-6283-491f-be25-c61affd35309 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:18.991616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:19.009235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:19.010397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:19.011355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:19.011634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:19.012263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:19.013773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527990c-6879-4774-ae74-6bc1073f4740 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:19.020788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 489/989] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:18 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:13:20.516854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100d75-bb67-4578-b7d8-e4baf68558e0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:20.517362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100d75-bb67-4578-b7d8-e4baf68558e0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:20.517362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100d75-bb67-4578-b7d8-e4baf68558e0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:20.518670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 501/990] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:20.523756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:20.524155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:20.524327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:20.543527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:20.544722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:20.613292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 490/991] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:20.883493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46100d75-bb67-4578-b7d8-e4baf68558e0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:20.959266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:20.987043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46100d75-bb67-4578-b7d8-e4baf68558e0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.020996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.021630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.021903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.022167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.022754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.024130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7a0bd857-1716-4af4-a5b6-8291f82f6f36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:21.034059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:21.035148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:21.035991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.037643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 502/992] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:21.041921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.150260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917f3ea-b8c8-4258-b681-507c5cdfa597 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.156230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a199-c328-47f4-bbd6-b3fa62606b7a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.156523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a199-c328-47f4-bbd6-b3fa62606b7a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.156826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808a199-c328-47f4-bbd6-b3fa62606b7a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.158165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 503/993] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:21.163049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052666b8-1b7b-46c9-a075-11e7be4ef4ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.163335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052666b8-1b7b-46c9-a075-11e7be4ef4ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.163612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052666b8-1b7b-46c9-a075-11e7be4ef4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.165640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.183930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-052666b8-1b7b-46c9-a075-11e7be4ef4ae None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:21.185254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-052666b8-1b7b-46c9-a075-11e7be4ef4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:21.188274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.188908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.189183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.189451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.190080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:21.190380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.191737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.196980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 491/994] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:21.202412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.264794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 504/995] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:21.266045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7baf-337a-46ac-a8ce-e996b08bb4c6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.266327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7baf-337a-46ac-a8ce-e996b08bb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.266600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7baf-337a-46ac-a8ce-e996b08bb4c6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.267830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 505/996] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:21.273077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.273552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.274000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.292739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:21.294191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:21.305522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c85f0-b0a0-456c-ba6a-18307cd8494e None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.340410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.341046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.341326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.341667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.342284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:21.342613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.343979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.348805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 492/997] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:21.355950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.366036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.373442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 506/998] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:21.402554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.462411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2050-e970-42b2-a0fc-90b0f21b85bd None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.498087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.498696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.498976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.499250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.499952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] RBAC: Adding query filter params (interface=public, service_id=698fa7182612411db5cc4035ea789597, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:21.500261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.501724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.512240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 493/999] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/endpoints?service_id=698fa7182612411db5cc4035ea789597&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:21.513790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.531483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.620839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234fe1-930f-48b3-bba2-adc1328a2027 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.637790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298ddb8-df4d-4dfc-85bc-841448967152 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.646457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.656691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.657219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.657493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.657760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.658357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.659700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.665738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 507/1000] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:13:21.666613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.687880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.688530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.688853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.689120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] PATH_INFO: `/v3/services/image` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.690410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.692099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:21.703917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:21.705246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:21.706272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:21.710222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 494/1001] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:21.711186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.738978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.788178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6585b5-d1bc-42ff-9c94-559558742f9e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.830599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11362f-266e-4520-a887-4210ccbb3244 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.832348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.833310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.833725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.834139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.835082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.836871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:21.853302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:21.855203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:21.856070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 508/1002] 10.222.0.71 () {56 vars in 1126 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:21.860985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.873474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:21.874087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:21.874506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:21.874784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:21.875418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:21.875724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:21.877268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:21.883585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 495/1003] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:21.889116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:21.925409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:21.965716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466e7d-d334-4f62-abeb-0a8c1698dc80 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:21.992187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:22.003675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:22.004289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:22.004698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:22.004869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:22.005467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:22.005763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:22.007113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:22.008571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bffef-43fd-4c2e-b4ae-71de03c1e4ff None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:22.013004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 509/1004] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:22.018666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:22.048057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:22.048760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:22.049040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:22.049382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:22.049932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:22.050228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:22.051819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:22.056632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 496/1005] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:22.130165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4de0f-7a4c-4275-b65a-80c8722eb97e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:22.173897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:22.174524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:22.174805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:22.175090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:22.175959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:22.176341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:22.178043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd913d-2f1d-42fa-b68f-4e178165662e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:22.189878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 510/1006] 10.222.0.71 () {56 vars in 1122 bytes} [Mon Sep 19 11:13:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:22.192064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:22.302040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:22.307191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc519db6-a1a4-46ce-801e-4ebdad6cbbf5 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:22.342479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:22.343211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:22.343565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:22.343912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:22.344683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:22.346117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac7d5d-e5f7-4900-a06e-d937c6f7622d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:22.363524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 497/1007] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:23.903998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da102-2d89-4b76-9db5-db2b2e883378 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:23.904557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da102-2d89-4b76-9db5-db2b2e883378 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:23.904557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da102-2d89-4b76-9db5-db2b2e883378 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:23.906039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 511/1008] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:23.911125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf05f43-e496-4e60-89f3-d1f5e9c11fcd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:23.911510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf05f43-e496-4e60-89f3-d1f5e9c11fcd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:23.911700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf05f43-e496-4e60-89f3-d1f5e9c11fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:23.929794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7bf05f43-e496-4e60-89f3-d1f5e9c11fcd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:23.930958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7bf05f43-e496-4e60-89f3-d1f5e9c11fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:24.005494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 498/1009] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:24.229443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af974-3f41-459a-8451-c8ffed0169d4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.229748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af974-3f41-459a-8451-c8ffed0169d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.229989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af974-3f41-459a-8451-c8ffed0169d4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.231469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 512/1010] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:24.236492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.236810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.237079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.255703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:24.256916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:24.272694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af974-3f41-459a-8451-c8ffed0169d4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:24.329751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:24.332634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 499/1011] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:24.379081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af974-3f41-459a-8451-c8ffed0169d4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:24.413176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:24.413797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.414080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.414350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.414926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:24.416328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b1177441-e34a-4115-8732-60b82cb502e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:24.425090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:24.426037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:24.429605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 513/1012] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:24.432938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:24.450298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:24.540152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660bbfe-7e23-4182-94b2-87ba84c9f9f4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:24.569456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683235-bc41-4e51-89a6-a004b232da09 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.569763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683235-bc41-4e51-89a6-a004b232da09 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.570014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683235-bc41-4e51-89a6-a004b232da09 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.571347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 514/1013] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:24.576150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:24.576397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.576704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.576821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.576987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.577092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.577291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.577915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:24.578210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:24.579565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:24.585576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 500/1014] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:24.592254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:24.596701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:24.597886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:24.665398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 515/1015] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:24.668009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:24.672181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:24.694385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9176b-378f-40dc-994a-3c317cae4d7a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:24.722719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:24.731318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:24.731920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.732198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.732472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.733145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:24.733445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:24.734805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:24.744248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 501/1016] 10.222.0.71 () {56 vars in 1112 bytes} [Mon Sep 19 11:13:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:24.745837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:24.779202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7badd0-fcc0-425e-8a79-5a31098e40dd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:24.816177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:24.816730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.817007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.817270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.817905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:24.819275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:24.838651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 516/1017] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:24 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:24.860293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae492-a8cd-4fd8-a225-6473f3b0c18a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:24.908147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce26fb-f597-4594-be21-90321347585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:24.909124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce26fb-f597-4594-be21-90321347585f None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:24.909663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce26fb-f597-4594-be21-90321347585f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:24.910167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce26fb-f597-4594-be21-90321347585f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:24.911020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce26fb-f597-4594-be21-90321347585f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:24.912698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce26fb-f597-4594-be21-90321347585f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:24.924237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:24.944378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 502/1018] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:24.946134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:25.074171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833011-f91d-4575-b72b-7512385c1beb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:25.084475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:25.122139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:25.122139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:25.122433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:25.122609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:25.123725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:25.125201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4a1d4-28dc-4e61-b3d2-b144ec1f6770 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:25.126762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 517/1019] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:25.132649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce26fb-f597-4594-be21-90321347585f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:25.241532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce26fb-f597-4594-be21-90321347585f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:25.280984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:25.281592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:25.281876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:25.282144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:25.282797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:25.284217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b7bc1-1c79-4e40-a73a-e9cf12bd49d5 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:25.313283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 503/1020] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:25 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:27.079111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ecca-d107-424f-890e-2bfbd1b54d47 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.079644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ecca-d107-424f-890e-2bfbd1b54d47 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.079644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ecca-d107-424f-890e-2bfbd1b54d47 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.081187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 518/1021] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:27.086292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e755-9c4f-4288-9293-411113999139 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.086743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e755-9c4f-4288-9293-411113999139 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.086826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6e755-9c4f-4288-9293-411113999139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.106662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63b6e755-9c4f-4288-9293-411113999139 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:27.107853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63b6e755-9c4f-4288-9293-411113999139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:27.156358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:27.185668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 504/1022] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:27.265560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add321-7f70-47b4-81e2-787425b2bb53 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.265882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add321-7f70-47b4-81e2-787425b2bb53 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.266118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add321-7f70-47b4-81e2-787425b2bb53 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.267595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 519/1023] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:27.272617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720d57b-e0c9-4267-8431-65acfa1a31b4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.272910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720d57b-e0c9-4267-8431-65acfa1a31b4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.273186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720d57b-e0c9-4267-8431-65acfa1a31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.292720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d720d57b-e0c9-4267-8431-65acfa1a31b4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:27.293903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d720d57b-e0c9-4267-8431-65acfa1a31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:27.363313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 505/1024] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:27.495944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add321-7f70-47b4-81e2-787425b2bb53 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.497950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c778-85a1-4e50-8dbf-775bc634d8b6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.498238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c778-85a1-4e50-8dbf-775bc634d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.498510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c778-85a1-4e50-8dbf-775bc634d8b6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.499979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 506/1025] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:27.505090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.505377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.505649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.524958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:27.526652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:27.604618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 507/1026] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:27.610492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add321-7f70-47b4-81e2-787425b2bb53 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:27.632557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.644214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:27.644862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.645138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.645400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.645979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:27.647324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:27.656815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:27.657826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:27.658711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 520/1027] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:27.666582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.673997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:27.718582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:27.746016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ffbfb-f758-45b3-bc48-a3487c36debf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:27.783755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:27.784380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.784810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.785094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.788310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e42f-3c7a-4729-bd41-bca2093d8bb8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:27.796433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:27.801258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:27.802212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:27.803065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:27.807996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 508/1028] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:27.809646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.830383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:27.831052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.831464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.831734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.832649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:27.833116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:27.834934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:27.842459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 521/1029] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:27.848229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.919658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:27.927211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3d6d-35d3-4e39-81cf-dc4545239d85 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:27.948558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:27.951296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46bf56-583f-4d4a-b8a1-08a396741fb4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:27.962350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:27.963666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.963949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.964223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.964929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:27.965231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:27.966607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:27.974702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 509/1030] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:27.975889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:27.987519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:27.988116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:27.988394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:27.988699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:27.989327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:27.989626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:27.990973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:27.996634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 522/1031] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:27.997076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.077165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b3b6a-2b2d-43b4-b730-451f166adc62 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.096716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7c1ee-1def-4a7d-853d-d55beb91217a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.110680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.111302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.111580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.111850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.112989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.114412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.115987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 510/1032] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:28.116790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.130537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.131158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.131435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.131704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.142098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.143519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.145689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:28.158538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:28.159554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:28.160488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:28.160488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:28.160488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:28.160488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 523/1033] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:28.160488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.178325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.225985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc577f-cc99-4cd8-a4d6-bb0f2a99088f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.260728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.261328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.261607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.261876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.262563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] RBAC: Adding query filter params (interface=public, service_id=4aafe1a4aabd49cfb173023a8d26a240, region_id=RegionOne) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:28.262867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.264221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.266483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7e29-1985-4f82-8f17-8aeb4ecb93ef None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.269304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 511/1034] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/endpoints?service_id=4aafe1a4aabd49cfb173023a8d26a240&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:28.269967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.300569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.301258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.301532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.301797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.302427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.303839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.326267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 524/1035] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:13:28 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:28.326903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.375243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.390057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75ed28-0438-4b7b-9bad-9848d10ddf76 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.410449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.430400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.431046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.431219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.432072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.433422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:28.433729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.435143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.449424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 512/1036] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:28.452573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c50710-5d1e-43d3-b613-93a7ea917706 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.455218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.496906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.497519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.497790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.498053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.498661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.500026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.508217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 525/1037] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:13:28.573315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa1c6f-f917-4305-ad59-05b3a5e89614 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.617849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.618498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.618773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.619049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.628019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.629536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:28.643083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:28.644167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:28.645181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 513/1038] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:28.653047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.761500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec45b04-1d99-4540-bc51-51d023fc3264 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.796286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.797245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.797737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.798200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:28.799139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:28.799637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:28.801372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:28.805042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.820863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 526/1039] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:28.827810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:28.841666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:28.938237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134384f-c4a4-4ae7-9363-9f4a57865c4d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:28.974134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:28.974743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:28.975273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:28.975541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.047395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.048887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.060549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:29.154095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 514/1040] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:13:29.160070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:29.264006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346f270-6bd7-4731-a9b5-420577c8b5eb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:29.299714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:29.300255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:29.300530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:29.300873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.311331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.312803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:29.329809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:29.330833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:29.331753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:29.331753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:29.331753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:29.331753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 527/1041] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:29.338618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:29.440783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbcfee-3569-482b-8a69-9523351b3d48 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:29.451989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:29.476970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:29.477567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:29.477839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:29.478112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.479259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:29.479621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.481002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.492304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 515/1042] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:29.498549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:29.545433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:29.599531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdc0-e51d-4d11-a847-88b4d31df791 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:29.633317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:29.633930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:29.634205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:29.634471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.641927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.643348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:29.654660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:29.655560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:29.656459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:29.660636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 528/1043] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:29.661837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:29.767225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a3b4f-1cc7-4f85-b4fd-85e604806e23 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:29.800474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:29.801105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:29.801384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:29.801654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.802344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:29.802646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.804065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f6f1-03ee-4bbe-a00d-0cd0831e6d48 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.821214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 516/1044] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:29.822807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:29.924420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1d4a-5c2f-4ae3-9e58-e19133212071 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:29.931042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:29.959056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:29.959646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:29.959921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:29.960187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:29.960935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] RBAC: Adding query filter params (role.id=f04542c7061349d39fd80a7c0b7c6d68, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:29.961240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:29.962639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eafca-da7d-40e2-8f90-fc7d6a794a42 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:29.976845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 529/1045] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:29 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=f04542c7061349d39fd80a7c0b7c6d68 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:30.627976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15318-6a23-4206-954c-93ef4a7b19c4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:30.628533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15318-6a23-4206-954c-93ef4a7b19c4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:30.628533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15318-6a23-4206-954c-93ef4a7b19c4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:30.629937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 517/1046] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:30.635285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:30.635837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:30.636025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:30.655923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:30.657143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:30.697333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011717-b693-4572-8123-b3edca5a9b84 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:30.697644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011717-b693-4572-8123-b3edca5a9b84 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:30.697876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011717-b693-4572-8123-b3edca5a9b84 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:30.699337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 518/1047] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:30.704222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:30.704505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:30.704803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:30.722989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:30.724198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:30.726493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 530/1048] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:30.749484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:30.795452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 519/1049] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:30.999400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.065590 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.106385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.110094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ca936-c8b4-432b-93a5-179bbf8e48f9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.146359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.146987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.147265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.147536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.158049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:31.162948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:31.163906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:31.164781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 531/1050] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:31.170426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.174187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8e33a-02a2-434a-b3c9-2730f560e44c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.213647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.214366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.214648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.214919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] PATH_INFO: `/v3/services/image` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.215508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.216917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:31.226515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:31.232873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:31.233827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 520/1051] 10.222.0.71 () {56 vars in 1105 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:31.234626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.260732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.289253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847cd17-21a9-491c-ab9f-597039d89dc9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.328063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.328694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.328975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.329264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.329906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:31.330344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.331678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.340920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c3e-58dc-4e24-bb56-b4d864800588 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.346028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 532/1052] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:31.347881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.374154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.383000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.383748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.383937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.384208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.384971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:31.385868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.386725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.392625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 521/1053] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:31.397483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.459429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab627994-ff00-4407-bd67-af1613aa2003 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.490712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.496943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.497621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.497925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.498200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] PATH_INFO: `/v3/users/839b2b6216b74b578c530ac42c48127e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.506048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bb37-20c9-4647-bdde-9ab36db451e3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.512542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] RBAC: Authorizing `identity:get_user(user_id=839b2b6216b74b578c530ac42c48127e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.513954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.515734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 533/1054] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/users/839b2b6216b74b578c530ac42c48127e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:31.521315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.551022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.551624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.551905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.552174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.552843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] RBAC: Adding query filter params (type=image) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:31.553153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.554546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.560116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 522/1055] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:31.565683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.609155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.632050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b93a-34f2-4b08-aa56-18f73f466172 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.670123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.670795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.671136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.671413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.678198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892ab45-faa8-4524-b807-006abe44d200 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:31.714940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:31.715548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:31.715832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:31.716106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:31.716802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.718173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.740791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 523/1056] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:13:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:13:31.748721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:31.750275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:31.844408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.868764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 534/1057] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:31.874170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:31.887435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:31.992664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2609e-4c5c-4718-9b9d-8537b1a8cf42 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:32.029852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:32.030509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.030788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.031061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.032286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:32.033801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94e5ef-24bf-4dd8-8f79-0bd5b1693819 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:32.040772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 524/1058] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:31 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:32.043238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:32.136770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee87c-b759-4c92-ad4d-987a91864813 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.136964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee87c-b759-4c92-ad4d-987a91864813 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.137508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee87c-b759-4c92-ad4d-987a91864813 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.138973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 525/1059] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:32.143702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.143983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.144261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.146334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366859e-4512-4b6d-bd4e-50bb987b25e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:32.162514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:32.163688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:32.182930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:32.183527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.183800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.184063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.184819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0, user.id=839b2b6216b74b578c530ac42c48127e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:32.185112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:32.186532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:32.192245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 535/1060] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:32 2022] GET /identity/v3/role_assignments?user.id=839b2b6216b74b578c530ac42c48127e&scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:32.249329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 526/1061] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:32.519133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:32.565739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:32.622376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f7d2-46dc-46e2-a193-000c07a6fa33 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:32.657235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:32.657857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.658132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.658399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.673125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:32.678081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:32.679018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:32.679867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:32.687859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 536/1062] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:32.687995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:32.688424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:32.793145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503feddc-18e2-42cd-8ae8-6f15f88b629a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:32.830526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:32.831183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.831484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.831756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:32.832422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:32.832776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:32.834246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:32.848380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 527/1063] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:32.850215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:32.958915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d022b-f275-4170-8b6f-fa6303326c81 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:32.961297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:32.997669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:32.998298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:32.998575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:32.998842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.009827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.011792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:33.027255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:33.028340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:33.029276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:33.029276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:33.029276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:33.032909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 537/1064] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:33.034070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.101813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:33.141371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144df1e6-d0f5-477b-9fa9-f3145ee3518d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.175240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:33.175841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.176119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.176388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.177046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:33.177346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.178704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.195446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 528/1065] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:33.198575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.301682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a040-6a71-446d-a8ec-1e70928dc466 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.335006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:33.335624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.335899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.336166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.343989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.345500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:33.366528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:33.368253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:33.370153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 538/1066] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:33.374148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.479228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842c469-fe9c-4d73-9c3e-3c0ee122aeb6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.502383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:33.513651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:33.514316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.514593 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.514858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.515584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:33.515884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.517327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.540657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 529/1067] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:33.542547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.561725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:33.645705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329375-4e43-4ed3-975f-19e4a0c6212e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.678046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:33.678672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.678925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.679191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.690364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.691783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:33.705735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:33.706684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:33.712185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:33.712185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:33.712185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:33.712185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 539/1068] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:33.714526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.813956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3508-688e-49ae-9b24-372646bbad10 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.851806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:33.852438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.852748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.853020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.853724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:33.854025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:33.855472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb894-1374-4cf0-bee9-c491153f56a1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:33.873954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 530/1069] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:33.875769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:33.943890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:33.959267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ffcdf-1dfd-4385-a254-6ab3e66d5d8e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.959598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ffcdf-1dfd-4385-a254-6ab3e66d5d8e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.959819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ffcdf-1dfd-4385-a254-6ab3e66d5d8e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.961427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 531/1070] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:33.966316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df999b3-d991-460e-906d-289721da7b17 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:33.966603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df999b3-d991-460e-906d-289721da7b17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:33.966878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df999b3-d991-460e-906d-289721da7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:33.980663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07aa9c-2715-4f45-bbf1-fea973f87417 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:33.986162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6df999b3-d991-460e-906d-289721da7b17 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:33.987345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6df999b3-d991-460e-906d-289721da7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:34.017562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:34.018188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.018529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.018803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.022810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.027062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:34.028555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:34.039959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:34.040914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:34.046661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 540/1071] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:34.048908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.064086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 532/1072] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:34.148138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf5103-06ed-418d-ab0f-22f94f04d3f0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:34.174764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.184289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:34.184922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.185203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.185475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.186170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:34.186472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:34.187880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:34.203645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 541/1073] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:34.209605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df999b3-d991-460e-906d-289721da7b17 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.313053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df999b3-d991-460e-906d-289721da7b17 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:34.336481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.356049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:34.356763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.357045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.357320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/f04542c7061349d39fd80a7c0b7c6d68` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.359601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=00af7c59942242d5ba2517f2c1b07d9a, role_id=f04542c7061349d39fd80a7c0b7c6d68)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:34.361140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f522c8-64e4-4cae-a2a4-5da33c4b85bb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:34.377293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 533/1074] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:13:34 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/00af7c59942242d5ba2517f2c1b07d9a/roles/f04542c7061349d39fd80a7c0b7c6d68 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:13:34.458388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5965-c0b7-48d6-82bc-4eb1f6b4aa21 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:34.492826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfa98-001a-4328-ada5-072d30adbf74 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.493219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfa98-001a-4328-ada5-072d30adbf74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.493620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfa98-001a-4328-ada5-072d30adbf74 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.495968 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 534/1075] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:34.497934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:34.498548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.498824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.499089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.501888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.502166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.502433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.525349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:34.526569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:34.557857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.576708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.591775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:34.593851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:34.606532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 535/1076] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:34.693881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 542/1077] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:13:34.700256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.801648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3b316-5677-44a8-bd1b-312ae992e669 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:34.835725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:34.836354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:34.836667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:34.836929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:34.847249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:34.848722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:34.864183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:34.865404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:34.866677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:34.866677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:34.866677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:34.868983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 536/1078] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:34.871539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.903622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:34.921785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.977045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:34.990207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab64fb-a21c-48b5-a38b-a8b6cdb3e049 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.015824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad09770-d69c-48d4-92fe-b7970d92e91f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.027475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.028192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.028463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.028754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.029399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:35.029694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:35.031215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:35.052707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 543/1079] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:35.063693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.064342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.064641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.064919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.078460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:35.083416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:35.084623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:35.085482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 537/1080] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:35.092740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:35.211934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e2446-cd52-45e2-95dd-4ac397de76d8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.253891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.254499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.254777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.255046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.255744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:35.256049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:35.257499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:35.267902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 544/1081] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:35.274240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:35.353747 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:35.380460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a821-e03c-4a1a-8ddf-958f0bd2c3a6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.413434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.414056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.414332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.414599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] PATH_INFO: `/v3/users/839b2b6216b74b578c530ac42c48127e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.416211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] RBAC: Authorizing `identity:get_user(user_id=839b2b6216b74b578c530ac42c48127e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:35.417674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:35.419249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 538/1082] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:35 2022] GET /identity/v3/users/839b2b6216b74b578c530ac42c48127e => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:35.425209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:35.437812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:35.521192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d830-81db-4166-97ba-1b05434df9ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.553706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.554311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.554583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.554855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.555947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:35.558079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f787f-ba97-4a23-a937-2cb7ddd10f1b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:35.559673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 545/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:35 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:35.565619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:35.664763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09995-5af6-4693-833f-49e6cce4232d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:35.698534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:35.699182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:35.699455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:35.699721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0/users/839b2b6216b74b578c530ac42c48127e/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:35.701637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b5663fbf1cd458fbe234e3869dfa3b0, user_id=839b2b6216b74b578c530ac42c48127e, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:35.703052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571cdbf-1aad-4074-9667-332d141830a0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:35.717040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 539/1084] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:13:35 2022] PUT /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0/users/839b2b6216b74b578c530ac42c48127e/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:13:36.617974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425a37-c181-494d-9d56-990ec29343d6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:36.618534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425a37-c181-494d-9d56-990ec29343d6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:36.618534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425a37-c181-494d-9d56-990ec29343d6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:36.620527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 546/1085] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:36.626074 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:36.626559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:36.626655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:36.633144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:36.647945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:36.649159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:36.732379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 540/1086] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:37.011451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425a37-c181-494d-9d56-990ec29343d6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.095243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:37.120221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425a37-c181-494d-9d56-990ec29343d6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.154211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.154821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.155095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.155360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.165284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:37.171102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:37.176679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:37.177929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 547/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:37.178642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.292535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22057c9-ddbb-4868-870e-b16df35c9b07 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.321341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:37.327059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.327689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.327969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.328234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.328948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:37.329249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:37.330608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:37.339443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 541/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:37.345374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.450718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44d9a-94a3-4633-bf56-9065b5254cd4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.486758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.487372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.487647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.487913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.494876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:37.499240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:37.500812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:37.514965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:37.516016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:37.516948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:37.516948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:37.516948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:37.516948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 548/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:37.521860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.622426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131f0-74fe-439d-98c7-bb598c07e58a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.654585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.655199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.655444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.655717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.656357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:37.656698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:37.658067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:37.670466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 542/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:37.676168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.780379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd773d-5e1e-4160-9087-eee774fa4690 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.815970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.816615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.816899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.817209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.825496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:37.827536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-71eb0083-3aad-4c41-98cf-b060abbef747 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:13:37.839309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:37.840414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:37.841744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 549/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:37.846604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:37.859647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79348-b670-4c46-bbe4-ab6b00b18799 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.859936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79348-b670-4c46-bbe4-ab6b00b18799 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.860209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79348-b670-4c46-bbe4-ab6b00b18799 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.861565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 550/1092] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:13:37.866741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.867019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.867288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.886606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:37.887713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:37.904839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:37.936254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:37.954708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6a0b-fcd9-4a77-8b29-ea913a0865be None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:37.957477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 551/1093] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:37.989955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:37.990563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:37.990837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:37.991106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:37.991823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:37.992125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:37.993585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.011036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 543/1094] 10.222.0.71 () {56 vars in 1133 bytes} [Mon Sep 19 11:13:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:38.016805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.117874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffa77-721a-4bbb-bfa3-c97b2f194f99 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.153111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.153637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.153914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.154183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.206237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.226278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.227713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.243598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.329002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 552/1095] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:13:38.334756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.344089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9834273-b7c5-499f-9d79-24b3eec57a64 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.358330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.380468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.381113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.381388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.381652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.393471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:13:38.396319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:38.397378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:13:38.398216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 544/1096] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:13:38.404327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.424931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.444788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19e6b-2047-4c91-a494-958b27f7a45d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.483706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.484332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.484629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.484895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.495858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.497334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.509260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e251-5f1f-4b8a-865e-0d1de1a0eb90 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:13:38.511777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:38.512868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:13:38.514046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:13:38.514046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:13:38.514046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:38.516723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 553/1097] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:38.518452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.544427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.545118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.545418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.545696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.546415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:38.546754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.548183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.557448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 545/1098] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:38.563112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.598381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.618575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b0448-a0a5-4a77-a698-b841f098091f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.646639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.652341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773862-8138-4d0e-888b-212368733682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.652965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773862-8138-4d0e-888b-212368733682 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.653242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773862-8138-4d0e-888b-212368733682 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.653516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773862-8138-4d0e-888b-212368733682 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.654152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773862-8138-4d0e-888b-212368733682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:38.654497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773862-8138-4d0e-888b-212368733682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.655787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773862-8138-4d0e-888b-212368733682 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.666645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbafd72-4be9-4d19-84c2-492218082d6c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.667851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 554/1099] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:38.673486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773862-8138-4d0e-888b-212368733682 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.700799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.701432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.701714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.701995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] PATH_INFO: `/v3/users/839b2b6216b74b578c530ac42c48127e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.703124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] RBAC: Authorizing `identity:get_user(user_id=839b2b6216b74b578c530ac42c48127e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.704655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.706580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 546/1100] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/users/839b2b6216b74b578c530ac42c48127e => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:38.711832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.773099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773862-8138-4d0e-888b-212368733682 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.808963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.809577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.809855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.810124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.812552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be25e5b-9df4-4081-b811-6710bf40c554 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.814084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.816725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.818145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:13:38.830060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:13:38.830981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:13:38.831871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 555/1101] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:13:38.838638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:38.851257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.851907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.852206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.852496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.889588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:38.920294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.921707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.936927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a01e1-6c39-4dfd-88bd-cd2e7b61474d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:38.969871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:38.970453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:38.970727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:38.970987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:38.971672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:38.971966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:38.973387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:38.986286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 556/1102] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:38.992358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:39.021043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 547/1103] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:13:39.027506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:39.029377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:39.089724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073986dd-51b8-44d7-8d86-aea940b07fa8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:39.102977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:39.124190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:39.124803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:39.125078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:39.125353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:39.126056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] RBAC: Adding query filter params (role.id=f04542c7061349d39fd80a7c0b7c6d68, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=00af7c59942242d5ba2517f2c1b07d9a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:39.126354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:39.127750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:39.130745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f65c8-98ba-409e-8268-576acd4b31dc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:39.133251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 557/1104] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:38 2022] GET /identity/v3/role_assignments?user.id=00af7c59942242d5ba2517f2c1b07d9a&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=f04542c7061349d39fd80a7c0b7c6d68 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:39.167511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:39.168150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:39.168421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:39.168725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:39.169887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:39.171396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122ee3-d7f1-4426-b0fa-1ea10c3c64b1 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:39.173094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 548/1105] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:39 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:13:39.179330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:39.284898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44623a2-acf0-4d84-9061-385f92932778 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:39.320146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:39.320781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:39.321063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:39.321334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:39.322103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0, user.id=839b2b6216b74b578c530ac42c48127e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:39.322412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:39.323822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5525c-eebd-475c-a907-7d02c0e249d9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:39.329668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 558/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:39 2022] GET /identity/v3/role_assignments?user.id=839b2b6216b74b578c530ac42c48127e&scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:41.489967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeea0b-bcb2-47b1-8fa1-2eac46b92587 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:41.490465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeea0b-bcb2-47b1-8fa1-2eac46b92587 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:41.490465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeea0b-bcb2-47b1-8fa1-2eac46b92587 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:41.491737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 549/1107] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:41.497661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:41.498105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:41.498200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:41.515983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:41.517223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:41.550363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:41.582778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 559/1108] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:41.851002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeea0b-bcb2-47b1-8fa1-2eac46b92587 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:41.921761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:41.952868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeea0b-bcb2-47b1-8fa1-2eac46b92587 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:41.986471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:41.987079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:41.987356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:41.987622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:41.988738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:41.990167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e6a14-776b-40df-aa58-e19a23840556 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:41.991709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 550/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:41.997796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:42.093476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef818a7-0c46-42aa-8983-0587d1846831 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:42.125636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:42.126163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:42.126446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:42.126715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:42.127357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:42.128788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9a082-85af-42c2-8e29-f1e730b2dfa6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:42.149918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 560/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:13:41 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:44.341743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4918073-6b85-434d-8d12-3c2cfa943ce7 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:44.342266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4918073-6b85-434d-8d12-3c2cfa943ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:44.342266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4918073-6b85-434d-8d12-3c2cfa943ce7 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:44.343644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 551/1111] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:44.348771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:44.349169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:44.349315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:44.367786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:44.369163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:44.388694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:44.434607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 561/1112] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:44.702915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4918073-6b85-434d-8d12-3c2cfa943ce7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:44.803940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4918073-6b85-434d-8d12-3c2cfa943ce7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:44.840809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:44.841474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:44.841730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:44.841998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] PATH_INFO: `/v3/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:44.843414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] RBAC: Authorizing `identity:get_role(role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:44.844821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:44.846159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 552/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:44 2022] GET /identity/v3/roles/6c5ab00012a74672bf6dcbc47131673e => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:44.852161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:44.947704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691b44-0163-4772-9971-0e7a89bc22a5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:44.981676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:44.982251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:44.982526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:44.982794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] PATH_INFO: `/v3/users/9fd9fac019084122a54754afe9f78338` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:44.995989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd9fac019084122a54754afe9f78338)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:44.997442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:44.999015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 562/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:44 2022] GET /identity/v3/users/9fd9fac019084122a54754afe9f78338 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:45.004706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:45.013296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:45.103019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a471-0377-4894-bb3d-3cce46111eec None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:45.135907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:45.136495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:45.136797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:45.137065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:45.201150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:45.202577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:45.210373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:45.300088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 553/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:45.306095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:45.321584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:45.406050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2379-09be-4589-a9e7-2aa9753cd597 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:45.438978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:45.439582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:45.439859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:45.440128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:45.441240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:45.442647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f803d1f-80bd-40ed-934d-46693011e076 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:45.444244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 563/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:45 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:45.450487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:45.550561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9db4a3-f9ad-4f99-ab39-13d5f80347fb None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:45.557533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:45.583702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:45.584291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:45.584571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:45.584870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:45.585585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0, user.id=9fd9fac019084122a54754afe9f78338) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:45.585895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:45.587316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e2c3d-318f-4e19-892d-c16d9652ac39 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:45.593266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 554/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:45 2022] GET /identity/v3/role_assignments?user.id=9fd9fac019084122a54754afe9f78338&scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:47.695833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fcde-8eff-4600-8f70-9136e8fec3f9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:47.696363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fcde-8eff-4600-8f70-9136e8fec3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:47.696363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fcde-8eff-4600-8f70-9136e8fec3f9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:47.698452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 564/1118] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:47.703594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee6af-173f-49db-8233-e266f9901395 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:47.703991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee6af-173f-49db-8233-e266f9901395 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:47.704126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ee6af-173f-49db-8233-e266f9901395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:47.721704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-209ee6af-173f-49db-8233-e266f9901395 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:47.722870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-209ee6af-173f-49db-8233-e266f9901395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:47.786487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 555/1119] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:13:48.076189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951fcde-8eff-4600-8f70-9136e8fec3f9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:48.155276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:48.174050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951fcde-8eff-4600-8f70-9136e8fec3f9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:48.207250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:48.207865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:48.208144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:48.208413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] PATH_INFO: `/v3/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:48.209830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] RBAC: Authorizing `identity:get_role(role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:48.211185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:48.212573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 565/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:48 2022] GET /identity/v3/roles/6c5ab00012a74672bf6dcbc47131673e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:48.218378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee6af-173f-49db-8233-e266f9901395 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:48.316795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:48.320874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ee6af-173f-49db-8233-e266f9901395 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:48.355939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:48.356491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:48.356801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:48.357073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] PATH_INFO: `/v3/users/9fd9fac019084122a54754afe9f78338` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:48.358178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=9fd9fac019084122a54754afe9f78338)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:48.359601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:48.361217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 556/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:48 2022] GET /identity/v3/users/9fd9fac019084122a54754afe9f78338 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:48.367021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:48.467432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784322-753d-4020-b403-dde15b143fd2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:48.504378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:48.505066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:48.505366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:48.505653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:48.506822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:48.508369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc22656-1055-464a-b7bb-f5593b73f1f4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:48.510211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 566/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:48 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:48.516603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:48.618915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72683-7e94-4615-9e78-6b8060338fd7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:48.652917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:48.653616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:48.653931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:48.654205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0/users/9fd9fac019084122a54754afe9f78338/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:48.656480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b5663fbf1cd458fbe234e3869dfa3b0, user_id=9fd9fac019084122a54754afe9f78338, role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:48.658078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe89576-ac86-4918-be17-165bd966c2e4 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:48.671567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 557/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:13:48 2022] PUT /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0/users/9fd9fac019084122a54754afe9f78338/roles/6c5ab00012a74672bf6dcbc47131673e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:13:50.903541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd3b4-ec69-4fcf-b2fd-27c941526e7c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:50.904078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd3b4-ec69-4fcf-b2fd-27c941526e7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:50.904078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd3b4-ec69-4fcf-b2fd-27c941526e7c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:50.905434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 567/1124] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:50.910812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:50.911182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:50.911401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:50.931030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:50.932915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:50.956324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:51.002216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 558/1125] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:51.284571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd3b4-ec69-4fcf-b2fd-27c941526e7c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:51.303475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:51.382569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd3b4-ec69-4fcf-b2fd-27c941526e7c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:51.414180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:51.414782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:51.415056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:51.415321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] PATH_INFO: `/v3/roles/6c5ab00012a74672bf6dcbc47131673e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:51.417411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] RBAC: Authorizing `identity:get_role(role_id=6c5ab00012a74672bf6dcbc47131673e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:51.418756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:51.420046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 568/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:51 2022] GET /identity/v3/roles/6c5ab00012a74672bf6dcbc47131673e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:51.426059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:51.526445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782df1-4609-471a-9fbf-742c3e61e2c7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:51.561080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:51.561742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:51.562043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:51.562355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] PATH_INFO: `/v3/users/9fd9fac019084122a54754afe9f78338` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:51.563464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] RBAC: Authorizing `identity:get_user(user_id=9fd9fac019084122a54754afe9f78338)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:51.564976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:51.566642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 559/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:13:51 2022] GET /identity/v3/users/9fd9fac019084122a54754afe9f78338 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:51.572486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:51.653531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:51.668451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba054c8a-59c4-4599-b30e-b94d4e4bac9b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:51.700767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:51.701349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:51.701622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:51.701886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:51.766253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:51.767668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:51.847012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:51.863321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 569/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:13:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:13:51.869743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:51.897439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:51.974318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7e69-44f3-45da-b2cd-787ef538be9d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:52.007931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:52.008540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:52.008867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:52.009134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] PATH_INFO: `/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:52.010309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5663fbf1cd458fbe234e3869dfa3b0)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:52.011717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a50ca-302a-476b-a5be-0dcebf134560 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:52.013339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 560/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:13:51 2022] GET /identity/v3/projects/0b5663fbf1cd458fbe234e3869dfa3b0 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:52.019491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:52.117465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6c6c-ff36-4efe-9387-0b92429302a0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:52.152016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:52.152626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:52.152907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:52.153175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:52.153891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] RBAC: Adding query filter params (role.id=6c5ab00012a74672bf6dcbc47131673e, scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0, user.id=9fd9fac019084122a54754afe9f78338) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:13:52.154202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:52.155604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ed268-ada9-4eb9-904d-2aa843b3d690 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:52.161171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 570/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:13:52 2022] GET /identity/v3/role_assignments?user.id=9fd9fac019084122a54754afe9f78338&scope.project.id=0b5663fbf1cd458fbe234e3869dfa3b0&role.id=6c5ab00012a74672bf6dcbc47131673e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:54.355488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272079-d5e4-43dd-8dfa-c6b5b67c8243 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:54.356023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272079-d5e4-43dd-8dfa-c6b5b67c8243 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:54.356023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272079-d5e4-43dd-8dfa-c6b5b67c8243 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:54.357442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 561/1131] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:54.362693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:54.363092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:54.363302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:54.383104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:54.384468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:54.429055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:54.450291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 571/1132] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:54.741341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72272079-d5e4-43dd-8dfa-c6b5b67c8243 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:54.836235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:54.844055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72272079-d5e4-43dd-8dfa-c6b5b67c8243 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:54.877729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:54.878338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:54.878613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:54.878879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:54.879964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:54.881422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25366-9e4a-4901-ad75-0de9cc361791 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:54.883028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 562/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:54.888970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:54.982366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c648ccb-c716-452e-ad31-86d284ce8b7f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:55.014628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:55.015146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:55.015420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:55.015683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:55.016319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:55.017743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa2980-b81a-4399-8226-a282c4317ee3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:55.044006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 572/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:13:54 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:13:57.215800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217bef-2b25-4edf-8dbf-ea8e9807393d None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:57.216198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217bef-2b25-4edf-8dbf-ea8e9807393d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:57.216341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0217bef-2b25-4edf-8dbf-ea8e9807393d None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:57.217708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 563/1135] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:57.223139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:57.223503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:57.223693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:57.241831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:57.243005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:57.268341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:57.309220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 573/1136] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:13:57.583416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0217bef-2b25-4edf-8dbf-ea8e9807393d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:57.683430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0217bef-2b25-4edf-8dbf-ea8e9807393d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:57.716367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:57.717006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:57.717287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:57.717561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:57.718671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:57.720100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa2578-9d14-4d54-aada-2a93dfee5e9a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:57.721676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 564/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:13:57.727685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:57.823699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30a15-39f1-466e-97a0-c0355033ed82 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:57.857657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:57.858185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:57.858462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:57.858730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:57.859715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:57.861169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74891085-8700-450d-a301-0d891ca6fce4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:57.881701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 574/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:13:57 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:00.062147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8537a3-c492-4925-aff0-8dc22fc7cac2 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:00.062683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8537a3-c492-4925-aff0-8dc22fc7cac2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:00.062683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8537a3-c492-4925-aff0-8dc22fc7cac2 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:00.064003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 565/1139] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:00.069373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:00.069748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:00.069911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:00.088982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:00.090143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:00.102946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:00.154745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 575/1140] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:00.425672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8537a3-c492-4925-aff0-8dc22fc7cac2 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:00.456527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:00.529200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8537a3-c492-4925-aff0-8dc22fc7cac2 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:00.562631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:00.563245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:00.563522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:00.563792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:00.573738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:00.578825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:00.579892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:00.580972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 566/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:00.588503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:00.683193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325c6d0-3576-4e67-9c35-e29748d574a7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:00.715331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:00.715913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:00.716188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:00.716455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:00.717133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:00.717430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:00.718775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:00.726782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 576/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:00.732977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:00.822381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:00.833600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6004c-503a-439f-b8ea-807a74eeaa1f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:00.866683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:00.867294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:00.867574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:00.867844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] PATH_INFO: `/v3/users/24ddb1b5a4994ac3ae56739317dcb04c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:00.881380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] RBAC: Authorizing `identity:get_user(user_id=24ddb1b5a4994ac3ae56739317dcb04c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:00.882806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:00.884429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 567/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:00 2022] GET /identity/v3/users/24ddb1b5a4994ac3ae56739317dcb04c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:00.890223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:00.902772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:00.990267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7325dcc-209a-438c-872a-c5d2e43312f8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:01.021738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:01.022319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:01.022592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:01.022856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:01.087973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:01.089580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:01.100052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:01.185254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 577/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:14:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:14:01.191163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:01.293088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306d58-e963-4359-b0dc-14ac36143468 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:01.327469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:01.328150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:01.328466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:01.328815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] PATH_INFO: `/v3/projects/f320e78552e74fbfa2aaa62e083d45dd` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:01.330057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] RBAC: Authorizing `identity:get_project(project_id=f320e78552e74fbfa2aaa62e083d45dd)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:01.331712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e446f-2786-4ba1-95fd-a4a3e66cec65 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:01.333575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 568/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:01 2022] GET /identity/v3/projects/f320e78552e74fbfa2aaa62e083d45dd => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:01.340291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:01.435748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e39b6a-7580-4cd5-a19e-e58e688066b7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:01.446697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:01.469923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:01.470512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:01.470785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:01.471050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:01.471765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=f320e78552e74fbfa2aaa62e083d45dd, user.id=24ddb1b5a4994ac3ae56739317dcb04c) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:01.472066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:01.473504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c66346-a896-4329-ab90-bcd0423e7547 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:01.479562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 578/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:14:01 2022] GET /identity/v3/role_assignments?user.id=24ddb1b5a4994ac3ae56739317dcb04c&scope.project.id=f320e78552e74fbfa2aaa62e083d45dd&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:03.616970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109729f4-5a05-421c-aedf-f94e96dfc753 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:03.617495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109729f4-5a05-421c-aedf-f94e96dfc753 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:03.617495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109729f4-5a05-421c-aedf-f94e96dfc753 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:03.619426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 569/1147] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:03.624683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:03.625074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:03.625233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:03.643619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:03.644829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:03.708218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 579/1148] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:03.981646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109729f4-5a05-421c-aedf-f94e96dfc753 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:03.999972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:04.082944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109729f4-5a05-421c-aedf-f94e96dfc753 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:04.119510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:04.120121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:04.120393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:04.120697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:04.130928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:04.137531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:04.138727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:04.140020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 570/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:04.145487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:04.241608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdc64f-8471-4dfa-affb-eb19beb713ca None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:04.243804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:04.274505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:04.275814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:04.276090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:04.276358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:04.277038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:04.277339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:04.278688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:04.286440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 580/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:04.292871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:04.367586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:04.391099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e93f7-16e9-4ac3-992a-7f76e28aa166 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:04.425935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:04.426545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:04.426821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:04.427089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] PATH_INFO: `/v3/users/24ddb1b5a4994ac3ae56739317dcb04c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:04.428181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] RBAC: Authorizing `identity:get_user(user_id=24ddb1b5a4994ac3ae56739317dcb04c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:04.429634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:04.432177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 571/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:04 2022] GET /identity/v3/users/24ddb1b5a4994ac3ae56739317dcb04c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:04.437756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:04.535688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4e2a5-8934-4ffc-af91-9a75748daa06 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:04.568189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:04.568826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:04.569109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:04.569384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] PATH_INFO: `/v3/projects/f320e78552e74fbfa2aaa62e083d45dd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:04.570489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] RBAC: Authorizing `identity:get_project(project_id=f320e78552e74fbfa2aaa62e083d45dd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:04.572141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b7850-6ca4-4efa-8081-740bf8736e7a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:04.573786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 581/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:04 2022] GET /identity/v3/projects/f320e78552e74fbfa2aaa62e083d45dd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:04.579602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:04.676171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac176c-91fb-4a47-b98a-7ebddb74cdef None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:04.709363 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:04.709998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:04.710272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:04.710536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] PATH_INFO: `/v3/projects/f320e78552e74fbfa2aaa62e083d45dd/users/24ddb1b5a4994ac3ae56739317dcb04c/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:04.712627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] RBAC: Authorizing `identity:create_grant(project_id=f320e78552e74fbfa2aaa62e083d45dd, user_id=24ddb1b5a4994ac3ae56739317dcb04c, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:04.714180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5078-82dc-45c2-b63e-3dc51e8aeefc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:04.727439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 572/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:14:04 2022] PUT /identity/v3/projects/f320e78552e74fbfa2aaa62e083d45dd/users/24ddb1b5a4994ac3ae56739317dcb04c/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:06.827903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae3f1-6b84-4153-b343-a2471414d96a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:06.828521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae3f1-6b84-4153-b343-a2471414d96a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:06.828521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae3f1-6b84-4153-b343-a2471414d96a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:06.829940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 582/1154] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:06.835412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:06.835929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:06.835929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:06.843445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:06.856727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:06.857902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:06.921999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 573/1155] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:14:07.189958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edae3f1-6b84-4153-b343-a2471414d96a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:07.225140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:07.290691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edae3f1-6b84-4153-b343-a2471414d96a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:07.323392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:07.324000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:07.324274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:07.324542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:07.334728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:07.339778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:07.340909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:14:07.342149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 583/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:07.346994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:07.442757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd79f9-a0e1-45bf-8626-a6c51b81346f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:07.475881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:07.476470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:07.476782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:07.477052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:07.477729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:07.478035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:07.479390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:07.480998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:07.488435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 574/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:07.495099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:07.586312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:07.595006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f3036-cfaa-41c1-ae0c-4dd5a50254e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:07.632491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:07.633128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:07.633404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:07.633671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] PATH_INFO: `/v3/users/24ddb1b5a4994ac3ae56739317dcb04c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:07.635000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] RBAC: Authorizing `identity:get_user(user_id=24ddb1b5a4994ac3ae56739317dcb04c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:07.636405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:07.638000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 584/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:07 2022] GET /identity/v3/users/24ddb1b5a4994ac3ae56739317dcb04c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:07.643684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:07.738879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080df-2979-40e9-8064-25104b462b3c None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:07.775817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:07.776407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:07.776713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:07.776983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:07.835259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:07.842099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:07.843540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:07.960785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 575/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:14:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:14:07.967333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:08.067322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad82d-6e7b-4ce8-a6e4-9c38067f0add None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:08.100200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:08.101100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:08.101375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:08.101641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] PATH_INFO: `/v3/projects/f320e78552e74fbfa2aaa62e083d45dd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:08.103399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f320e78552e74fbfa2aaa62e083d45dd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:08.105239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d4bbf-201a-4116-b6b0-6a09871217a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:08.106851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 585/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:07 2022] GET /identity/v3/projects/f320e78552e74fbfa2aaa62e083d45dd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:08.113043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:08.202910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:08.209492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87623c16-b443-412a-8f0c-6217a5f4b987 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:08.244016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:08.244632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:08.244917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:08.245189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:08.245908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=f320e78552e74fbfa2aaa62e083d45dd, user.id=24ddb1b5a4994ac3ae56739317dcb04c) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:08.246214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:08.247637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68db695-c614-45a1-b629-0f4a16daa92d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:08.253286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 576/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:14:08 2022] GET /identity/v3/role_assignments?user.id=24ddb1b5a4994ac3ae56739317dcb04c&scope.project.id=f320e78552e74fbfa2aaa62e083d45dd&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:10.546294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e647-b442-4510-80bd-8cbc238f0348 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:10.546806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e647-b442-4510-80bd-8cbc238f0348 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:10.546897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5e647-b442-4510-80bd-8cbc238f0348 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:10.548168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 586/1162] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:14:10.553489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:10.553914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:10.554033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:10.572313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:10.573512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:10.638599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 577/1163] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:10.903115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e647-b442-4510-80bd-8cbc238f0348 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:10.934077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:11.004449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5e647-b442-4510-80bd-8cbc238f0348 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:11.037080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:11.037667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:11.037942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:11.038208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:11.103199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:11.104655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:11.131602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:11.200154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 587/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:14:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:14:11.205966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:11.296603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:11.306837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9c2e-d794-4e99-b86b-94bc9a2c8978 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:11.342229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:11.342854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:11.343132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:11.343402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:11.350056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:11.351750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2a0fe91b-c102-4f95-bcd6-8423bfe7a893 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:11.363415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:11.364700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:14:11.365769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:11.367850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 578/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:14:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:11.374115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:11.472341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a60807-d100-4d7c-bd27-c049a6bed201 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:11.501032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:11.507401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:11.508004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:11.508281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:11.508551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:11.510218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:11.510525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:11.511884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d033-0ba5-408e-8a22-95223130512d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:11.519050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 588/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Mon Sep 19 11:14:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:14:13.660473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edb501-1e69-4716-a5a0-30dc4ffb405c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:13.661047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edb501-1e69-4716-a5a0-30dc4ffb405c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:13.661047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edb501-1e69-4716-a5a0-30dc4ffb405c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:13.662406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 579/1167] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:13.668301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd97c-f5ad-4d9b-9642-dcf258013d95 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:13.668743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd97c-f5ad-4d9b-9642-dcf258013d95 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:13.668871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd97c-f5ad-4d9b-9642-dcf258013d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:13.688004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-021bd97c-f5ad-4d9b-9642-dcf258013d95 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:13.689200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-021bd97c-f5ad-4d9b-9642-dcf258013d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:13.752699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 589/1168] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:14.022750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edb501-1e69-4716-a5a0-30dc4ffb405c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:14.122547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edb501-1e69-4716-a5a0-30dc4ffb405c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:14.155065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:14.155650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:14.155930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:14.156203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:14.156886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:14.158255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068be6-cf6d-4801-95a8-42f2241a1544 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:14.174188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 580/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Mon Sep 19 11:14:14 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:16.342993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bea6b-6b57-4911-906e-4afd0eacbd0c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:16.343531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bea6b-6b57-4911-906e-4afd0eacbd0c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:16.343531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bea6b-6b57-4911-906e-4afd0eacbd0c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:16.344895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 590/1170] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:16.350038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:16.350472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:16.350861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:16.369344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:16.370508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:16.373219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:16.436331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 581/1171] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:16.702268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bea6b-6b57-4911-906e-4afd0eacbd0c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:16.817344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bea6b-6b57-4911-906e-4afd0eacbd0c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:16.842165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:16.852634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:16.853327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:16.853602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:16.853870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] PATH_INFO: `/v3/domains/007cac566691465ab6235e721e3c963d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:16.863808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=007cac566691465ab6235e721e3c963d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:16.865251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7976f7-30ef-420e-9d37-627c40c8e231 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:16.866805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 591/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Mon Sep 19 11:14:16 2022] GET /identity/v3/domains/007cac566691465ab6235e721e3c963d => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:16.872727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:16.970054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac97730-3a79-4bce-aead-113bbafa0d68 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:17.004322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:17.005108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:17.005565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:17.006013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:17.007020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:17.009991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00bc8b-4833-4e64-ad8e-f2aa45a032ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:17.021829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:17.037172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 582/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:14:16 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:19.198995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78344-0507-4662-8bf5-6437feedc4d5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:19.199550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78344-0507-4662-8bf5-6437feedc4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:19.199550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78344-0507-4662-8bf5-6437feedc4d5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:19.200882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 592/1174] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:19.206220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:19.206595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:19.206758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:19.225501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:19.226927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:19.295842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 583/1175] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:19.565926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78344-0507-4662-8bf5-6437feedc4d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:19.663857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78344-0507-4662-8bf5-6437feedc4d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:19.694998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:19.695603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:19.695876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:19.696142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] PATH_INFO: `/v3/domains/007cac566691465ab6235e721e3c963d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:19.697988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] RBAC: Authorizing `identity:get_domain(domain_id=007cac566691465ab6235e721e3c963d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:19.699401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74e08-449d-46b8-bdfe-31d9ea19618c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:19.700965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 593/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Mon Sep 19 11:14:19 2022] GET /identity/v3/domains/007cac566691465ab6235e721e3c963d => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:19.706609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:19.802138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a506a-5384-43cd-9faa-48d337b13c3c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:19.824336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:19.836784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:19.837507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:19.837783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:19.838048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:19.838688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:19.840101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06628da-4266-45f4-91d2-efff850181dd None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:19.860802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 584/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:14:19 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:22.055162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517991c-9fe5-41c2-9326-dc1066c73fa0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:22.055737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517991c-9fe5-41c2-9326-dc1066c73fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:22.055854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517991c-9fe5-41c2-9326-dc1066c73fa0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:22.057265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 594/1178] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:22.062632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:22.063032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:22.063169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:22.081636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:22.082796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:22.147436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 585/1179] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:22.421999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517991c-9fe5-41c2-9326-dc1066c73fa0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:22.474123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:22.520433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517991c-9fe5-41c2-9326-dc1066c73fa0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:22.553090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:22.553729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:22.554006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:22.554271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:22.566163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:22.570914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:22.572237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:14:22.573117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 595/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:22.578176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:22.673744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8d2e6-9c09-4036-a8a8-1728105d3800 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:22.682993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:22.708170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:22.708788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:22.709065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:22.709333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:22.709988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:22.710284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:22.711669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:22.719390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 586/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:22.725360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:22.821064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96375b98-059e-4d18-b8b6-1e00b5b8c424 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:22.833791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:22.855900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:22.856508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:22.856812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:22.857079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] PATH_INFO: `/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:22.871381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] RBAC: Authorizing `identity:get_user(user_id=ede720a1d73a4ad08bc8d7a3a7ae39c2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:22.872848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:22.874471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 596/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:22 2022] GET /identity/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:22.880296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:22.977041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdf3b1-8103-46de-9615-358f70a733ee None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:23.008876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:23.009462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:23.009732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:23.009998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:23.047724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:23.075297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:23.076793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:23.171154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 587/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:14:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:14:23.177210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:23.273768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42afeb-b23a-4221-9a52-e5624efe57c8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:23.308062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:23.308771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:23.309053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:23.309318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] PATH_INFO: `/v3/projects/55302c66201e4898ae93f36cc36e6f0b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:23.310497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] RBAC: Authorizing `identity:get_project(project_id=55302c66201e4898ae93f36cc36e6f0b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:23.311898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ddb1e-1bd6-44e5-9487-bd4ea049ecf3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:23.313528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 597/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:23 2022] GET /identity/v3/projects/55302c66201e4898ae93f36cc36e6f0b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:23.319722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:23.389291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:23.420852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292fd61-1b5a-4af7-981f-56127c64a4c9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:23.455090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:23.455681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:23.455957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:23.456226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:23.456967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=55302c66201e4898ae93f36cc36e6f0b, user.id=ede720a1d73a4ad08bc8d7a3a7ae39c2) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:23.457271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:23.458687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78b0e-fa20-4639-acf1-0f8ffb2b4add None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:23.464867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 588/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:14:23 2022] GET /identity/v3/role_assignments?user.id=ede720a1d73a4ad08bc8d7a3a7ae39c2&scope.project.id=55302c66201e4898ae93f36cc36e6f0b&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:25.632352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3aeaa-89e2-451b-9705-8ad3315b1a9a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:25.632946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3aeaa-89e2-451b-9705-8ad3315b1a9a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:25.632946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3aeaa-89e2-451b-9705-8ad3315b1a9a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:25.634451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 598/1186] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:25.639608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:25.639992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:25.640154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:25.658361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:25.659537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:25.724952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 589/1187] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:25.998974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3aeaa-89e2-451b-9705-8ad3315b1a9a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:26.038552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:26.097716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3aeaa-89e2-451b-9705-8ad3315b1a9a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:26.131724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:26.132322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:26.132621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:26.132893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:26.143491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:26.148223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:26.149408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:14:26.150851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 599/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:26.155694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:26.220793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:26.259850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733266-e4d6-406d-8613-0ae020faf7b5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:26.292476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:26.293083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:26.293357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:26.293621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:26.294266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:26.294558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:26.295907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:26.303559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 590/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:26.310649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:26.404955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:26.408449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c429-38f6-46cd-a266-9febe9fdd607 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:26.443638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:26.444254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:26.444530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:26.444831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] PATH_INFO: `/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:26.445945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] RBAC: Authorizing `identity:get_user(user_id=ede720a1d73a4ad08bc8d7a3a7ae39c2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:26.448149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:26.449755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 600/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:26 2022] GET /identity/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:26.455957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:26.558514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef87b-31e4-4fb4-841e-37cc58cc39fc None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:26.583258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:26.592809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:26.593429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:26.593711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:26.593985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] PATH_INFO: `/v3/projects/55302c66201e4898ae93f36cc36e6f0b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:26.595100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] RBAC: Authorizing `identity:get_project(project_id=55302c66201e4898ae93f36cc36e6f0b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:26.596531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c781d-bf99-40e9-b0eb-d3205481e416 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:26.598193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 591/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:26 2022] GET /identity/v3/projects/55302c66201e4898ae93f36cc36e6f0b => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:26.604628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:26.700633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df024daf-4de6-4b07-8816-b09d21b39d7e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:26.741250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:26.741909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:26.742183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:26.742449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] PATH_INFO: `/v3/projects/55302c66201e4898ae93f36cc36e6f0b/users/ede720a1d73a4ad08bc8d7a3a7ae39c2/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:26.745001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] RBAC: Authorizing `identity:create_grant(project_id=55302c66201e4898ae93f36cc36e6f0b, user_id=ede720a1d73a4ad08bc8d7a3a7ae39c2, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:26.746436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28425e-6dad-4f60-ac26-a57d61df5bec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:26.761137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 601/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:14:26 2022] PUT /identity/v3/projects/55302c66201e4898ae93f36cc36e6f0b/users/ede720a1d73a4ad08bc8d7a3a7ae39c2/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:28.885595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d9ab-17a2-4c50-ae8c-ac84b3d24bb8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:28.886152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d9ab-17a2-4c50-ae8c-ac84b3d24bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:28.886152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d9ab-17a2-4c50-ae8c-ac84b3d24bb8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:28.887470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 592/1193] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:28.892695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:28.893084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:28.893246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:28.911987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:28.913186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:28.933812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:28.983200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 602/1194] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:14:29.262616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d9ab-17a2-4c50-ae8c-ac84b3d24bb8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:29.363216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d9ab-17a2-4c50-ae8c-ac84b3d24bb8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:29.395398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:29.396005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:29.396280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:29.396545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:29.406809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:14:29.411535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:14:29.412627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:14:29.413487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 593/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:14:29.419576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:29.515760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9db1e-72f6-4530-9abc-bc923e862774 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:29.548325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:29.548937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:29.549211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:29.549477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:29.550125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:29.550419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:29.551762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:29.560024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 603/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:29.565814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:29.619709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:29.662962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1ec0d-5c17-4361-8955-14b7edea7ca4 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:29.695303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:29.695907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:29.696226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:29.696529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] PATH_INFO: `/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:29.697654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] RBAC: Authorizing `identity:get_user(user_id=ede720a1d73a4ad08bc8d7a3a7ae39c2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:29.699101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:29.700666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 594/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Mon Sep 19 11:14:29 2022] GET /identity/v3/users/ede720a1d73a4ad08bc8d7a3a7ae39c2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:29.706421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:29.726045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:29.803799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e49fd-6fc0-4635-96e3-86a83a323259 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:29.835600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:29.836183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:29.836460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:29.837390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:29.901320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:29.902731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:29.920396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:29.996340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 604/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:14:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:14:30.002246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:30.098138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5ab8-414b-4be1-8475-a2daa9ab8fac None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:30.120553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:30.132043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:30.132688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:30.132967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:30.133237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] PATH_INFO: `/v3/projects/55302c66201e4898ae93f36cc36e6f0b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:30.134525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=55302c66201e4898ae93f36cc36e6f0b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:30.135934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567d804-203b-45d3-b9cb-b6a3a5556bc7 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:30.137582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 595/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Mon Sep 19 11:14:30 2022] GET /identity/v3/projects/55302c66201e4898ae93f36cc36e6f0b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:30.143666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:30.239868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06498-e31f-41ed-9663-627a375848ec None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:30.256731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:30.272931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:30.273524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:30.273794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:30.274058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:30.274866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=55302c66201e4898ae93f36cc36e6f0b, user.id=ede720a1d73a4ad08bc8d7a3a7ae39c2) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:30.275164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:30.276560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848459c-15cb-4cad-af28-6f99cec7fb4b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:30.282057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 605/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:14:30 2022] GET /identity/v3/role_assignments?user.id=ede720a1d73a4ad08bc8d7a3a7ae39c2&scope.project.id=55302c66201e4898ae93f36cc36e6f0b&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:40.128044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:40.279554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=9 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:26.507093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e06-b5d1-4541-ab71-7bed7e5fdc21 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.508517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e06-b5d1-4541-ab71-7bed7e5fdc21 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.508517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6e06-b5d1-4541-ab71-7bed7e5fdc21 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.510998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 596/1201] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:26.519492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.520021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.520354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.556463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:26.558427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.670010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 606/1202] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:26.953113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6e06-b5d1-4541-ab71-7bed7e5fdc21 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.092808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6e06-b5d1-4541-ab71-7bed7e5fdc21 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.133495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.134596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.135102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.135586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.154511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.156345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:27.172097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:27.176920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:27.178310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:27.178310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:27.178310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:27.178310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 597/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:15:27.179500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.317791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921877e2-13ae-4893-8f03-8f66d20e69bc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.357428 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:27.363964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.367463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.374752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.374752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.374752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:27.374752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.376437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ff947-b52f-4136-a019-0a8b073d16e0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.395098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 607/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:27.396208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.461781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:27.534509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16326ab-4697-423b-abcd-6c58756006d9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.577793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.578368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.578639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.579008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.579547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.581065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb162bbe-c38a-4400-a7b8-66b5de1b13d3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.606174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 598/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Mon Sep 19 11:15:27 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:30.191778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8302-73ca-4a39-b417-850b7c5fd4d1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.192347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8302-73ca-4a39-b417-850b7c5fd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.192347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a8302-73ca-4a39-b417-850b7c5fd4d1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.193693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 608/1206] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:30.199624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.200103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.200204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.225361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:30.227116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:30.301723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 599/1207] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:30.613562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a8302-73ca-4a39-b417-850b7c5fd4d1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.727390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a8302-73ca-4a39-b417-850b7c5fd4d1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.770018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.770660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.770980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.771274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.784119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:30.789911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:30.791029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:30.791934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 609/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:30.797357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.844205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:30.923626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6c60d-6001-44f6-811a-e205c893071f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.962675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.963338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.963640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.963918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.964639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:30.964943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.966354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.975287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 600/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:30.982310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.041297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:31.106552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196eb0-b099-45c6-a474-8b9849917be4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.146646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.147452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.147821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.148261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.161717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.163286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:31.180442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:31.181674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:31.182691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:31.182691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:31.182691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:31.189441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 610/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:31.189597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.313512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:31.318914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18900c-402f-48c2-9f39-ecb41b5da2d0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.360428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.361070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.361348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.361614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.362310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:31.362611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.364051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.389534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 601/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:31.389734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.509258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91774-bd8d-4513-ac5d-a18c65780605 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.511050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:31.547034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.547652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.547924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.548189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.555885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.557330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:31.569918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:31.571656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:31.572962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:31.576454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 611/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:31.578251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.696465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1d89-0db3-4da4-a24f-e26499a23042 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.738307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.739182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.739761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.740182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.741369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:31.741842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.744484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.770259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 602/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:31.775668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.901502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f5e3-d3f0-4159-9135-1922845ad169 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.937730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.938431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.938786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.939050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.971649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.019792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.021336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.133482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 612/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:15:32.139552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.159721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.256448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7f1fa-c58b-4045-a91c-5f3b75354c1f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.295174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.295842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.296119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.296384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.307971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.309498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:32.326403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:32.327883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:32.328878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:32.328878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:32.328878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:32.328878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 603/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:15:32.334451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.401108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.445749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c2a1-da58-4a4c-801c-acf173ae51fc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.489001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.489714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.490015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.490290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.493053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:32.493423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.495034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.508996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 613/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:32.515224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.609086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.646952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94055-65bc-460b-ab56-a64aaa21a322 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.684240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265e399-8503-4760-8b20-986046214a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.684994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265e399-8503-4760-8b20-986046214a8f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.685332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265e399-8503-4760-8b20-986046214a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.685680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265e399-8503-4760-8b20-986046214a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.694219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265e399-8503-4760-8b20-986046214a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.695958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265e399-8503-4760-8b20-986046214a8f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-c265e399-8503-4760-8b20-986046214a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:32.707994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:32.709180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:32.710259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:32.714932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 604/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:32.716074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.828885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0217c0-b86f-40ad-9125-af72670474a6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.857595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.871158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.871737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.872051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.872518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.873264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:32.873584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.875133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a2c2-0923-43d5-bb11-92df24d70398 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.888326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 614/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:32.894696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265e399-8503-4760-8b20-986046214a8f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.011049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265e399-8503-4760-8b20-986046214a8f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.050162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:33.057306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.058030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.058331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.058654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.059541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=3189482c61b44937a73c99ff6ec36cc4) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:33.059852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.061315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5b0c-64b6-4c8d-b32f-aaa9ea935b0c None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.066814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 605/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/role_assignments?user.id=3189482c61b44937a73c99ff6ec36cc4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:35.306139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89434-7eeb-4b19-86f7-66e51ca8e080 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.306778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89434-7eeb-4b19-86f7-66e51ca8e080 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.306778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89434-7eeb-4b19-86f7-66e51ca8e080 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.307947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 615/1220] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:35.313307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.313749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.313875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.333081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:35.334278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.406610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 606/1221] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:35.703219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f89434-7eeb-4b19-86f7-66e51ca8e080 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.816733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f89434-7eeb-4b19-86f7-66e51ca8e080 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.859320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.860011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.860290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.860666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.872741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:35.878511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:35.879724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:35.880812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 616/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:35.888610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.993437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a6fe4-c4cf-4ec5-b6f9-3bd960705b33 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.017465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.029272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.029873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.030151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.030416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.031073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:36.031368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.032761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.041405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 607/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:36.047353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.094440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.160401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6f962-e2b4-4d59-91f3-efdff9594258 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.201438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.202264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.202620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.202998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.215896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.217592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:36.235540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:36.236962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:36.238771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:36.238771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:36.238771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:36.244095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 617/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:36.245009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.360718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387115-c100-4677-b482-8116f824bb47 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.396844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.397500 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.397828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.398127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.398811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:36.399154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.400490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.412490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 608/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:36.419170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.522542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.530765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c358d-c3eb-401d-b2d8-a26548d46a2f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.566611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.567249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.567516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.567786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.575492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.577012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:36.589055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:36.590331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:36.591556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 618/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:15:36.595979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.644296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.706042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d0f7-e974-4937-82a2-5d307aa76db9 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.741148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.741796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.742764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.743116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.744010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:36.744408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.745882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.769616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 609/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:36.770818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.878488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15083-f74c-44cf-ad69-d2cc7d5adf01 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.918934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.919586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.919869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.920139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.934904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.935340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:36.953393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:36.955760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:36.956711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:36.956711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:36.956711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:36.956711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 619/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:36.962149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.074992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb4421-e8d2-42df-92b9-d0ee9ed586c2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.077331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.113461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.114158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.114433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.114698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.115334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:37.115620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.117582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.129657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 610/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:37.136040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.145679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.253706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f57d-ff22-4360-86eb-79a9a590bf6b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.290686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.291301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.291579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.291849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.298657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.300093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:37.311609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:37.312617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:37.313605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:37.317790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 620/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:15:37.319112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.427533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecee34e-3f49-4d02-909a-82d737fee943 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.463507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.464216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.464479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.464816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.465513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:37.465822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.467259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebf71c-c81d-43df-a362-26171c67d83b None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.481127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 611/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:37.487268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.558817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.596107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91236e5-02d9-410a-8579-ef47f211d068 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.635210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.635867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.636143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.636410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/3189482c61b44937a73c99ff6ec36cc4/roles/fb5907de266c4f0383828ac180c8575b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.651376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=3189482c61b44937a73c99ff6ec36cc4, role_id=fb5907de266c4f0383828ac180c8575b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.652879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f523-105b-4830-b096-3132792bedfa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.667203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 621/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:15:37 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/3189482c61b44937a73c99ff6ec36cc4/roles/fb5907de266c4f0383828ac180c8575b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:39.845253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8761a-139b-41c3-9c95-6a98913916b6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.845866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8761a-139b-41c3-9c95-6a98913916b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.846020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8761a-139b-41c3-9c95-6a98913916b6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.847740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 612/1233] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:39.854382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.854879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.854982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.878229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:39.879471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.949853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 622/1234] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:15:40.220258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8761a-139b-41c3-9c95-6a98913916b6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.248620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.332997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8761a-139b-41c3-9c95-6a98913916b6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.374869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.375660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.375954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.376284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.390620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:40.395693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:40.396878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:40.397846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 613/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:40.403418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.450324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.508864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ff297-44b9-4b14-873a-775b294da80d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.545462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.546255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.546677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.547080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.547821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:40.548213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.549709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.558031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 623/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:40.564077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.654611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.670561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0d638-0cea-482d-823e-a336a0ee6cd0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.712072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.712790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.713025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.713301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.723940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.725464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:40.740900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:40.742237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:40.743505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:40.743505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:40.743505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:40.743505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 614/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:15:40.748028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.857540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aec47-6559-4db8-94e5-8e6edfcad001 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.872529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.906677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.907291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.907570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.907841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.908487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:40.908931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.910687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.927757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 624/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:40.934448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.055061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3577-41b1-439c-a1af-31ea3047d86a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.097467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.098142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.098415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.098722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.102515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:41.109039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.111332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:41.123942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:41.125099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:41.126126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 615/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:41.131167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.250881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca57b62-b942-43bf-8297-2030c02b552f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.289418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.290330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.290895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.291245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.292237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:41.292796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.294844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.319171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 625/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:41.326188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.449620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105411-122c-4b4a-aec6-15ecaa1778a2 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.488367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.489022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.489358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.489649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.557667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:41.564808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.566261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.681167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 616/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:15:41.687883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.720379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:41.807844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7644-f5b2-4a03-86e0-ebe9245b6f9e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.855663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.856451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.857328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.857328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.870591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.872758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:41.893472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:41.894665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:41.895758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:41.895758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:41.895758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:41.895758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 626/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:41.904787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.009925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.015967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbdf77-3b2f-4ff5-94e4-72da57f649c6 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.053841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.054918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.055212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.055484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.056127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:42.056427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.057823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.069406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 617/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:42.076166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.183458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.213054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1d005-8f25-433b-a74a-d44f412cdb0a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.255592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.256393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.256725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.256993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.266666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.268023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:42.283035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:42.284244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:42.285405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 627/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:42.290553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.402183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306b7b-a65c-42d1-a4d4-9048b43bec88 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.440801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.441415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.441700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.441973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.442710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:42.443059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.444792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8aa18-19f1-4116-9108-9720fb95ac8f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.463620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 618/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:42.465276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.583647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c7852-657b-496c-ba68-0557a38de05e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.622579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.623179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.623573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.623960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.624712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] RBAC: Adding query filter params (role.id=fb5907de266c4f0383828ac180c8575b, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=3189482c61b44937a73c99ff6ec36cc4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:42.625024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.626663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798515a8-98e1-4d9b-8c2e-883643231f55 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.633665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 628/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/role_assignments?user.id=3189482c61b44937a73c99ff6ec36cc4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=fb5907de266c4f0383828ac180c8575b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:45.129828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222d33-e426-4499-96e3-48e33055c3c3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.130476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222d33-e426-4499-96e3-48e33055c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.130476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222d33-e426-4499-96e3-48e33055c3c3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.131706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 619/1247] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:15:45.137787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.138389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.138623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.145856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.160250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:45.161848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.237796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 629/1248] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:45.542215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222d33-e426-4499-96e3-48e33055c3c3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.561992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.655298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222d33-e426-4499-96e3-48e33055c3c3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.693445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.694108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.694397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.694667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.706423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:45.711704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:45.712799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:45.713903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 620/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:45.719828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.827266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecceb3-f029-4e47-bc82-8d4c8d712065 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.863302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.869804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.870453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.870737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.871065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.871743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:45.872050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.874113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.890481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 630/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:45.891912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.987066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.013349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225dfb7-9f21-48af-9150-20471405257a None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.050530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.051169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.051446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.051717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.063376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.064897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:46.081534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:46.082762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:46.083875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:46.083875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:46.083875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:46.084257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 621/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:46.088940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.193091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9717b-622e-4ac3-9270-e7eb9eaa96a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.232598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.233213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.233490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.233757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.234402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:46.234699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.236057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.248653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 631/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:46.254553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.361756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dfe67-b27d-439e-8858-89b4a5fb3333 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.387817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.396084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.396838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.397181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.397507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.405702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.407129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:46.419424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:46.420612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:46.421741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 622/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:46.426530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.484011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.528825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab962c30-a6b8-490f-b301-073905d3eb8b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.562534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.563131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.563404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.563671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.564389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:46.564714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.566113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.585348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 632/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:46.591860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.691183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfbae-0468-4b8f-86a8-0d9b47b51e82 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.724891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.725484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.725763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.726033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.779814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.792544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.794038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.899751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 623/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:15:46.905718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.001564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93ef0-d079-4f71-a0ce-85183f1493a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.014976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.035539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.036151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.036425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.036725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.046474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.047912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:47.062596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:47.063688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:47.065003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:47.065003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:47.065003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:47.065003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 633/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:47.069391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.153336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.165310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd802b-606f-4a8a-87a0-09496f9506df None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.198599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.199194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.199468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.199732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.200362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:47.200689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.202050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.213354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 624/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:47.218937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.315072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da639-3558-41f7-b5d1-95f240109793 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.347570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.348158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.348430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.348727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.355309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.356749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:47.367569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:47.368631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:47.369973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 634/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:47.374563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.472779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c329eb-6753-4de1-adf9-227067bcfd0d None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.505600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.506198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.506480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.506752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.508021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:47.508429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.509887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507df0f8-60f6-4f7c-bd84-ca41c7841f8f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.521558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 625/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:47.528235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.553044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.624722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bda1f4-bc9a-49a4-8bba-e5820dba4908 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.657103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.657686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.657965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.658234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.658948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=3189482c61b44937a73c99ff6ec36cc4) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:47.659253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.660685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3c4c-31fb-47bc-a129-f06ca1a44ffb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.666638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 635/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/role_assignments?user.id=3189482c61b44937a73c99ff6ec36cc4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:49.800518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef751c6-92e9-4947-97ee-1bd4efe7eb1b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:49.801076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef751c6-92e9-4947-97ee-1bd4efe7eb1b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:49.801076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef751c6-92e9-4947-97ee-1bd4efe7eb1b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:49.802419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 626/1261] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:49.807689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:49.808112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:49.808212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:49.826520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:49.827686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:49.907636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 636/1262] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:50.176715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef751c6-92e9-4947-97ee-1bd4efe7eb1b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.188388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.290013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef751c6-92e9-4947-97ee-1bd4efe7eb1b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.323776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.324865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.325144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.325411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.336182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:50.341095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:50.342147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:50.343196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 627/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:50.348220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.366050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.442997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dadd1-9f38-4b91-ab54-c10cfd19f28a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.476394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.477269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.477542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.477806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.478457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:50.478748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.480083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.487783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 637/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:50.493723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.563670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.597791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e459b91-ddea-4167-afec-89f39fb321c7 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.635889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.636502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.636809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.637078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.646780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.648939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:50.663898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:50.665075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:50.666213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:50.666213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:50.666213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:50.666213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 628/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:50.670896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.749549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.769079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f70a9f-f37c-45d8-9b59-b9a429700216 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.801401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.802027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.802331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.802620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.803286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:50.803606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.805621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.817014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 638/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:50.823570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.928860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ef18-411d-44f0-b7fd-61e77e27c396 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.948841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.962702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.963342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.963615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.963878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.970984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.972402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:50.983407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:50.989083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:50.990282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 629/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:50.990994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.090493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb2369-8bb4-467a-90dc-9521e283962d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.123222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.123804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.124081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.124348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.125095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:51.125398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.126791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.136243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:51.144701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 639/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:51.150998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.248398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef0a5-ae11-4ed4-bbec-f465d5213e3f None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.279900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.280504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.280806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.281072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.291621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.293085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:51.307453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:51.308561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:51.309482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:51.309482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:51.309482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:51.309482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 630/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:51.314252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.408493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00f075-75d1-45c8-8f88-8bd03e831eb9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.441424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.442006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.442283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.442550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.443180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:51.443478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.444874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.455684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 640/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:51.461958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.493545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:51.559830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3a5a1-c258-4b21-b6b1-f37e4d63c4f0 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.592007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.592632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.592911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.593180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.599656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.601649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:51.612774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:51.613772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:51.615070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 631/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:51.619682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.676205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:51.717042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed99-b84f-4d30-a8d6-ad973882818f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.749157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.749738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.750008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.750271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.750949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:51.751249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.752791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1fb4f-9d8e-4b88-97ac-a71085de5d49 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.764124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 641/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:51.770034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.862582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:51.873673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5f0e-a04d-41e1-8e37-a92341044797 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.907826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.908468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.908777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.909050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] PATH_INFO: `/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/3189482c61b44937a73c99ff6ec36cc4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.910910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] RBAC: Authorizing `identity:create_grant(project_id=64d0f4bb6cbe479a9933412a80f42edc, user_id=3189482c61b44937a73c99ff6ec36cc4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.912334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea36d7b-cc1d-44e1-ba3d-1c8aeaef8226 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.924720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 632/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Mon Sep 19 11:15:51 2022] PUT /identity/v3/projects/64d0f4bb6cbe479a9933412a80f42edc/users/3189482c61b44937a73c99ff6ec36cc4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:54.052337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e1d5-5656-4676-8675-673c64dfc2bf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.052944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e1d5-5656-4676-8675-673c64dfc2bf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.052944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e1d5-5656-4676-8675-673c64dfc2bf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.054890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 642/1274] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:54.060370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.060828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.060943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.079347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:54.080529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.145353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 633/1275] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:54.413268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e1d5-5656-4676-8675-673c64dfc2bf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.513389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e1d5-5656-4676-8675-673c64dfc2bf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.530233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:54.546443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.547052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.547328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.547594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.558098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:15:54.562874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:54.563973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:54.565010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 643/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Mon Sep 19 11:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:54.570552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.649270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:54.668073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4bb54-6dc8-4afe-bc3e-3c4fca1fc5fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.701617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.702211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.702490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.702760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.703417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:54.703717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.705107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.713641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 634/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Mon Sep 19 11:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:54.719444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.815632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971209-ec2a-4512-817f-f8a7fd33b9c3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.850235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.850922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.851776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.852304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.863950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.865433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:54.883055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:54.884438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:54.885561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:54.885561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:54.885561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:54.885561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 644/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:54.890786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.993620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0573375-a59d-4297-8c49-496d96f36542 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.025611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.026200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.026473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.026739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.027364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:55.027659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.029037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.040844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 635/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:55.046565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.076438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.142915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621ba01-d86a-42c2-a935-373cdaa998ce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.175709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.176318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.176619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.176897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.184702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.186126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:15:55.196968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:55.198111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:55.199052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 645/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:55.203957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.207860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.303638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495f53-de4b-4df7-a606-3df5c2fc1c17 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.336763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.337362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.337641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.337912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.338635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:55.338946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.340373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.357756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 636/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:55.363537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.451385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.461656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fadfbd-4c21-40c8-adf5-2c252b6b502b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.494640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.495223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.495501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.495771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.560077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.561465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.646492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.656508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 646/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:15:55.662261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.721498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.760143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b013-f5b8-4eb1-9f5c-f6cd3610d9e3 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.792906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.793519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.793794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.794065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.803732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.805540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:15:55.821120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:55.822229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:15:55.823150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:15:55.823150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:15:55.823150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:55.823150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 637/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:55.827769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.927039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6626-6509-4c74-be5c-c9d00fec7425 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.959753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.960509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.960827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.961095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.961729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:55.962026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.963367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.974042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 647/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:55.980057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.088201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90546c4-ffe1-40e8-8182-e0b9e3b67c15 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.101243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:56.121611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.122230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.122508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.122781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.129181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.130611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:15:56.142328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:56.143367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: ERROR keystone.server.flask.application Sep 19 11:15:56.144475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 638/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:56.149335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.197060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:56.245643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafd1c-b60d-4031-8cd9-e466fc5851b6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.277845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.278429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.278702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.278967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.279642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:56.279937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.281367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090be3-506d-4ffc-ba1c-60024d204c56 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.293359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 648/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Mon Sep 19 11:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:56.303333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.402970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228cc3-3cbb-418b-81e8-30890504a209 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.436055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.436672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.436954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.437230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.437947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] RBAC: Adding query filter params (role.id=831a0d01705f489683bef40d08847bc6, scope.project.id=64d0f4bb6cbe479a9933412a80f42edc, user.id=3189482c61b44937a73c99ff6ec36cc4) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:56.438253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.439676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c634867-27f3-460a-be83-5b6f8ffebaee None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.445325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 639/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Mon Sep 19 11:15:56 2022] GET /identity/v3/role_assignments?user.id=3189482c61b44937a73c99ff6ec36cc4&scope.project.id=64d0f4bb6cbe479a9933412a80f42edc&role.id=831a0d01705f489683bef40d08847bc6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:58.657081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3cd7-c8f4-41ea-be83-dbda3d6873b8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.657613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3cd7-c8f4-41ea-be83-dbda3d6873b8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.657613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3cd7-c8f4-41ea-be83-dbda3d6873b8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.658931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 649/1288] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:58.664538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.665010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.665094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.683897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.685099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.714744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:58.752560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 640/1289] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:15:59.031402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3cd7-c8f4-41ea-be83-dbda3d6873b8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.129685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3cd7-c8f4-41ea-be83-dbda3d6873b8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.140473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.165182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.165796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.166068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.166332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.166900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.168280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:15:59.176795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:15:59.178023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:15:59.179084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 650/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:15:59.183940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.281164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f80f46-26ea-4585-9897-3f962743a7c8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.314262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.314860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.315141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.315415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.316036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:59.316337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.317745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c43fdb-ab09-49db-8e85-e18e343b9534 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.322955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 641/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:59.328723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.433027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22409-3d21-4b75-a84a-9f58ebf4d48e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.466293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.466888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.467167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.467439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.468063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:59.468364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.469759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcd356-de12-4dd3-b021-0fb360ddcfc8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.474136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 651/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:16:01.624331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da037c-be9c-43e0-9672-8c3ebc6a24dd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:01.624910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da037c-be9c-43e0-9672-8c3ebc6a24dd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:01.624910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da037c-be9c-43e0-9672-8c3ebc6a24dd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:01.626238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 642/1293] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:16:01.631459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ccd3-1b8a-4eba-8cfe-1c35679918f6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:01.631829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ccd3-1b8a-4eba-8cfe-1c35679918f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:01.631999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ccd3-1b8a-4eba-8cfe-1c35679918f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:01.651007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ed93ccd3-1b8a-4eba-8cfe-1c35679918f6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:01.652174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed93ccd3-1b8a-4eba-8cfe-1c35679918f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:01.680460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:01.717782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 652/1294] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:16:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:16:01.991137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da037c-be9c-43e0-9672-8c3ebc6a24dd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:02.021223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:02.091756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da037c-be9c-43e0-9672-8c3ebc6a24dd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:02.130261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:02.130860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:02.131142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:02.131415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:02.132053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:02.133450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d82c-4eb7-4764-aa20-f21fdd07b3ec None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:02.147168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 643/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Mon Sep 19 11:16:01 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:04.327968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1c3-6b8d-4ea8-8797-465bc5cdc57d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.328525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1c3-6b8d-4ea8-8797-465bc5cdc57d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.328525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1c3-6b8d-4ea8-8797-465bc5cdc57d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.329856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 653/1296] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:16:04.334868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.335286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.335473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.354395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:04.355576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:04.425626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 644/1297] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:16:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:16:04.693395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a1c3-6b8d-4ea8-8797-465bc5cdc57d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:04.791249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a1c3-6b8d-4ea8-8797-465bc5cdc57d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:04.823253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:04.823852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.824123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.824388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.824994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:04.826325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:16:04.834712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:16:04.836466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:04.837338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 654/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:16:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:16:04.844495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:04.865427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:04.956498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b353e2-a033-4812-ae63-400a734aa8f5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:04.989284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:04.989880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.990159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.990430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.991053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:16:04.991350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:04.993329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:04.998291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 645/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Sep 19 11:16:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:16:05.004230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:05.034719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:05.100766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9182bc-b115-440e-a415-b74ab2d07763 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:05.133317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:05.133896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:05.134167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:05.134433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:05.135115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] RBAC: Adding query filter params (interface=public, service_id=272de839cd1540e9b8f68daa0399a407, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:16:05.135412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:05.136768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39db83-5f4d-485c-a7e7-4034deaad511 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:05.141481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 655/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Mon Sep 19 11:16:05 2022] GET /identity/v3/endpoints?service_id=272de839cd1540e9b8f68daa0399a407&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:16:05.147103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:05.228315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:05.246506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e0803-2e30-4373-ad13-0b76d74b7691 None admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:05.279159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:05.279749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:05.280023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:05.280286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:05.280913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:05.282270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7450db-8efe-4bb1-8030-fb51da000d8e None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:05.289423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 646/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Mon Sep 19 11:16:05 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:16:07.421302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c970-f76d-4696-a9b0-430c1e22a6c4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:07.421874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c970-f76d-4696-a9b0-430c1e22a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:07.421874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8c970-f76d-4696-a9b0-430c1e22a6c4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:07.423164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 656/1302] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:16:07.428327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:07.428786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:07.428888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:07.447781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:07.448979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:07.513340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 647/1303] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:16:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:16:07.784953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8c970-f76d-4696-a9b0-430c1e22a6c4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:07.884519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:07.891879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8c970-f76d-4696-a9b0-430c1e22a6c4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:07.923636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:07.924242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:07.924515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:07.924808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:07.925384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:07.926717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:16:07.935820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:16:07.937086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 19 11:16:07.938024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 657/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Mon Sep 19 11:16:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:16:07.942843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:08.015992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:08.039212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4b5e-2c2a-477d-ad9c-302c996d3b74 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:08.071181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:08.071769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:08.072042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:08.072309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] PATH_INFO: `/v3/services` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:08.072953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:16:08.073252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:08.074603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da57dc-463c-4362-af52-0d23923712dc None admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:08.079512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 648/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Mon Sep 19 11:16:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:16:08.085795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:08.186237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062104b5-ebc6-4f65-87f1-3a337bbbfe4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:08.222026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:08.222624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:08.222903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:08.223175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:08.223847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:08.225345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8826-6fe5-4f5c-b5e3-b867baf2bc89 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:08.244870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 658/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:16:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:18.076641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=30 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:18.240403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:12.982637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191536-2713-4a03-a94a-7df9b251a275 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.983108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191536-2713-4a03-a94a-7df9b251a275 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.983307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191536-2713-4a03-a94a-7df9b251a275 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.989060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 649/1307] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:12.991091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f149b-bfe6-4176-9084-01f7faf2edfe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.991742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f149b-bfe6-4176-9084-01f7faf2edfe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.991742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f149b-bfe6-4176-9084-01f7faf2edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.207163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cd3f149b-bfe6-4176-9084-01f7faf2edfe None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:13.211883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd3f149b-bfe6-4176-9084-01f7faf2edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.336004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 659/1308] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:13.630821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.631573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.631904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.633469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 650/1309] 10.222.0.71 () {54 vars in 963 bytes} [Mon Sep 19 11:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:13.639763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e567d-bef4-4463-ae48-4bdbc144d727 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.640134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e567d-bef4-4463-ae48-4bdbc144d727 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.640473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e567d-bef4-4463-ae48-4bdbc144d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.726463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-be3e567d-bef4-4463-ae48-4bdbc144d727 None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:13.727688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-be3e567d-bef4-4463-ae48-4bdbc144d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.750052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:13.811454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 660/1310] 10.222.0.71 () {58 vars in 1060 bytes} [Mon Sep 19 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:13.820511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:13.822320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.937918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd088c-44d3-41d5-8951-5a2a5135fa4e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:14.020217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:14.021452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.021452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.022104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.024528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.093586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:14.155373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:14.156845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6a32b-5df3-4ac5-817f-02dfb0e5075a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:14.176994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 651/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:16.684733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:16.685273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:16.685273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:16.686620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 661/1312] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:16.691931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b106c-67fb-4127-8364-70befef14256 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:16.692626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b106c-67fb-4127-8364-70befef14256 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:16.692916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b106c-67fb-4127-8364-70befef14256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:16.770161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4e6b106c-67fb-4127-8364-70befef14256 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:16.771358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4e6b106c-67fb-4127-8364-70befef14256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:16.868895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 652/1313] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:17.172887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:17.174497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:17.284002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da8ca9-889e-46e6-8c59-4e777c952e94 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:17.357809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:17.360329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:17.361145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:17.361588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:17.362108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:17.363799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:17.472154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:17.473520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53104f-6122-46a2-b5c9-380a03ef908c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:17.492992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 662/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:19.967351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:19.967922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:19.967922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:19.969285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 653/1315] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:19.974496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf6c5-3985-4a2f-9223-659e93ba5721 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:19.974963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf6c5-3985-4a2f-9223-659e93ba5721 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:19.975573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf6c5-3985-4a2f-9223-659e93ba5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:20.040462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7accf6c5-3985-4a2f-9223-659e93ba5721 None None] MFA Rules not processed for user `1529def0a8464361b52f97a79ae54344`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:20.041700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7accf6c5-3985-4a2f-9223-659e93ba5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:20.093478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:20.137183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 663/1316] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:20.425628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:20.427162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:20.437428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:20.530900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7cf4-87f0-41f6-b04f-bdf262d58735 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:20.604278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:20.604903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:20.605176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:20.605440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:20.607026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:20.667256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:20.714491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:20.715913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387d3de-1459-4a6a-8810-4aaf9ff73276 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:20.734716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 654/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:23.422286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:23.422815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:23.422910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:23.424208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 664/1318] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:23.430136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffed0fe-708b-4e85-9277-1052364cebfb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:23.430602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffed0fe-708b-4e85-9277-1052364cebfb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:23.430745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffed0fe-708b-4e85-9277-1052364cebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:23.497722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5ffed0fe-708b-4e85-9277-1052364cebfb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:23.498820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5ffed0fe-708b-4e85-9277-1052364cebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:23.592206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 655/1319] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:23.879656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:23.881282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:23.982795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9440d-8a27-4074-812d-a796f2a7e026 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:24.054501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:24.055085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:24.055355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:24.055616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:24.057217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:24.063886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:24.165423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:24.166770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2af1-38d7-4317-bd79-c6a974ab4933 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:24.184686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 665/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:26.963702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574996-6526-4301-909a-b115e0d32661 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:26.964269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574996-6526-4301-909a-b115e0d32661 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:26.964269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78574996-6526-4301-909a-b115e0d32661 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:26.965642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 656/1321] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:26.971047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050bd6-3534-42d2-895e-be980f5d716a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:26.971477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050bd6-3534-42d2-895e-be980f5d716a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:26.971592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050bd6-3534-42d2-895e-be980f5d716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:27.045750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0b050bd6-3534-42d2-895e-be980f5d716a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:27.046975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0b050bd6-3534-42d2-895e-be980f5d716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:27.109236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:27.153620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 666/1322] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:27.435654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574996-6526-4301-909a-b115e0d32661 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:27.437266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-78574996-6526-4301-909a-b115e0d32661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:27.457828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:27.542056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78574996-6526-4301-909a-b115e0d32661 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:27.616854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:27.617461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:27.617740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:27.618011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:27.619617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:27.689527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:27.731525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:27.733013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f6637-0531-43b5-90ac-2a8432d00279 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:27.751444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 657/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:29.997081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:29.997618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:29.997618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:29.998943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 667/1324] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:30.004233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e711-d886-4e82-9234-0e19a3a5b279 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:30.004689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e711-d886-4e82-9234-0e19a3a5b279 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:30.004810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14e711-d886-4e82-9234-0e19a3a5b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:30.073485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8b14e711-d886-4e82-9234-0e19a3a5b279 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:30.074676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8b14e711-d886-4e82-9234-0e19a3a5b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:30.181597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 658/1325] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:30.462164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:30.463705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:30.567851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca0fd-6b0f-4242-836c-92411c771483 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:30.642961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:30.643830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:30.644242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:30.644678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:30.647164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:30.671969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:30.776153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:30.777541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2980-9b74-4384-b622-e49c3ba6a266 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:30.796445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 668/1326] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:33.059199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:33.059734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:33.059734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:33.061109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 659/1327] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:33.066260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677269e-81cb-4709-998e-7d53117b6199 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:33.066670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677269e-81cb-4709-998e-7d53117b6199 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:33.066789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677269e-81cb-4709-998e-7d53117b6199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:33.132477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3677269e-81cb-4709-998e-7d53117b6199 None None] MFA Rules not processed for user `1529def0a8464361b52f97a79ae54344`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:33.133753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3677269e-81cb-4709-998e-7d53117b6199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:33.200638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:33.234419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 669/1328] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:33.526662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:33.528207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:33.562233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:33.636052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291986d-16ee-42db-8525-bf3841204e2a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:33.708775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:33.709932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:33.710220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:33.710450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:33.712036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:33.789982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:33.822634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:33.824075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476462af-fa47-49f6-945c-e6d6b36ba642 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:33.841673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 660/1329] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:36.225457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:36.225886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:36.226007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:36.227328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 670/1330] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:36.232721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510546d-4131-4526-877b-15a5b95619e1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:36.233105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510546d-4131-4526-877b-15a5b95619e1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:36.233273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510546d-4131-4526-877b-15a5b95619e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:36.300033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c510546d-4131-4526-877b-15a5b95619e1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:36.301289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c510546d-4131-4526-877b-15a5b95619e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:36.398953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 661/1331] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:36.678633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:36.680259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:36.780058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73407cb-abe6-4e48-a685-307f546efef8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:36.856161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:36.856785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:36.857061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:36.857326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:36.858911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:36.885330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:36.967920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:36.969329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d002-5f97-421e-8f3c-c77069c88292 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:36.988562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 671/1332] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:39.188298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:39.188965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:39.188965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:39.190145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 662/1333] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:17:39.196151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ff08-4c35-4a09-90f3-1b3fcf597195 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:39.196615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ff08-4c35-4a09-90f3-1b3fcf597195 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:39.196736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3ff08-4c35-4a09-90f3-1b3fcf597195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:39.263527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-59b3ff08-4c35-4a09-90f3-1b3fcf597195 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:39.264822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59b3ff08-4c35-4a09-90f3-1b3fcf597195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:39.338631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:39.361465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 672/1334] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:39.655358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:39.656957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:39.697957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:39.761282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097e2a2-5ad1-41b7-92e9-37808c17a55e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:39.833410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:39.834618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:39.834891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:39.835162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:39.836787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:39.920659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:39.946461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:39.947935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ccb70-0c16-4722-a5c0-f9a7156786fa service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:39.966141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 663/1335] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:42.452752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8ca7-2f24-4d63-8a88-93c4bf072d23 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:42.453403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8ca7-2f24-4d63-8a88-93c4bf072d23 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:42.453403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8ca7-2f24-4d63-8a88-93c4bf072d23 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:42.454631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 673/1336] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:42.460437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f9f4-f8a2-4786-b356-60e2a2c8632e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:42.460936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f9f4-f8a2-4786-b356-60e2a2c8632e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:42.460936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f9f4-f8a2-4786-b356-60e2a2c8632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:42.525779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cda9f9f4-f8a2-4786-b356-60e2a2c8632e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:42.526984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cda9f9f4-f8a2-4786-b356-60e2a2c8632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:42.622914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 664/1337] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:42.922548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:42.922834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:42.923109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:42.924476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 674/1338] 10.222.0.71 () {54 vars in 963 bytes} [Mon Sep 19 11:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:42.931195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087acb-0ab9-44fd-b621-e0044d8b23f6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:42.931489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087acb-0ab9-44fd-b621-e0044d8b23f6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:42.931761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087acb-0ab9-44fd-b621-e0044d8b23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:42.985859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:43.009102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8c087acb-0ab9-44fd-b621-e0044d8b23f6 None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:43.010316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8c087acb-0ab9-44fd-b621-e0044d8b23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:43.083925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 665/1339] 10.222.0.71 () {58 vars in 1060 bytes} [Mon Sep 19 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:43.093067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:43.094584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:43.195637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ee491-1533-4555-93fc-bfa30db4cfca None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:43.271114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:43.271705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:43.271979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:43.272243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:43.273854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:43.311069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:43.383533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:43.385032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432934-a67d-4705-83bc-bdce63dc0cad service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:43.402919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 675/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:48.131864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:48.132421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:48.132707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:48.134233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 666/1341] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:48.139859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d265e3-cd98-4796-a231-2d3d209ef30b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:48.140307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d265e3-cd98-4796-a231-2d3d209ef30b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:48.140642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d265e3-cd98-4796-a231-2d3d209ef30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:48.224657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e7d265e3-cd98-4796-a231-2d3d209ef30b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:48.226450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e7d265e3-cd98-4796-a231-2d3d209ef30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:48.320223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:48.331794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 676/1342] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:48.619353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:48.620916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:48.726434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17753506-350d-4f2c-aa4d-625ed6d934db None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:48.764521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:48.800566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:48.801186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:48.801462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:48.801728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:48.803874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:48.917674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:48.919032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985c40e-1d56-4135-b5bb-82e82ef56f6f service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:48.938636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 667/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:51.741820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:51.742353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:51.742353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:51.743655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 677/1344] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:51.749189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e76a2-8265-4602-a79b-56196d97d35a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:51.749611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e76a2-8265-4602-a79b-56196d97d35a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:51.749744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e76a2-8265-4602-a79b-56196d97d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:51.816367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-649e76a2-8265-4602-a79b-56196d97d35a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:51.817614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-649e76a2-8265-4602-a79b-56196d97d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:51.836371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:51.921354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 668/1345] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:52.204154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:52.205850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:52.317454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566f257-a034-40f2-aafb-ac1bfad9a48a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:52.393825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:52.394422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:52.394701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:52.394970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:52.397269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:52.440411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:52.509741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:52.511043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c34a-44c4-4ca7-8868-fba0d419d676 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:52.530234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 678/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:56.955095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:56.955605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:56.955605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:56.956946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 669/1347] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:56.963349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616990-3c85-4ef9-9d03-30436e6a1181 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:56.963794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616990-3c85-4ef9-9d03-30436e6a1181 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:56.963887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616990-3c85-4ef9-9d03-30436e6a1181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:57.032287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ff616990-3c85-4ef9-9d03-30436e6a1181 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:57.033551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff616990-3c85-4ef9-9d03-30436e6a1181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:57.128568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:57.131121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 679/1348] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:57.413071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:57.414616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:57.521187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597238f-ab0e-4054-955a-dbe659271504 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:57.570424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:57.595617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:57.596209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:57.596487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:57.596784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:57.598356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:57.705433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:57.706890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da78929-4b20-40c2-8d8c-74e410165671 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:57.728467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 670/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:02.759553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99c5a-da4b-4aca-a304-2585d8fd746a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:02.760055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99c5a-da4b-4aca-a304-2585d8fd746a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:02.760138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99c5a-da4b-4aca-a304-2585d8fd746a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:02.761607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 680/1350] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:02.775461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112632-9cf3-48d9-bb1b-025517d32183 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:02.775950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112632-9cf3-48d9-bb1b-025517d32183 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:02.776031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82112632-9cf3-48d9-bb1b-025517d32183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:02.904870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-82112632-9cf3-48d9-bb1b-025517d32183 None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:02.906909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-82112632-9cf3-48d9-bb1b-025517d32183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:02.942612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:03.060853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 671/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:07.446340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547b0a4-e54a-4f11-a675-6f31ccb4ab6b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:07.446838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547b0a4-e54a-4f11-a675-6f31ccb4ab6b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:07.446838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547b0a4-e54a-4f11-a675-6f31ccb4ab6b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:07.448192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 681/1352] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:07.453540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36be60-4976-428e-80da-a5ce523d524b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:07.453975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36be60-4976-428e-80da-a5ce523d524b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:07.454066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36be60-4976-428e-80da-a5ce523d524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:07.534270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9d36be60-4976-428e-80da-a5ce523d524b None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:07.535509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9d36be60-4976-428e-80da-a5ce523d524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:07.657566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:07.710355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 672/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:18:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:08.996608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3cd59-b653-40b4-b40d-1eef90f63fa5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:08.997190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3cd59-b653-40b4-b40d-1eef90f63fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:08.997190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3cd59-b653-40b4-b40d-1eef90f63fa5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:08.998505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 682/1354] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:09.003534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537901-28ef-4eae-a9e1-ad850765a4ec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:09.004016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537901-28ef-4eae-a9e1-ad850765a4ec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:09.004116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f537901-28ef-4eae-a9e1-ad850765a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:09.085624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4f537901-28ef-4eae-a9e1-ad850765a4ec None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:09.086863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f537901-28ef-4eae-a9e1-ad850765a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:09.208172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 673/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:12.710219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b330d-9255-474e-932d-b0e73de0d39f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:12.710805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b330d-9255-474e-932d-b0e73de0d39f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:12.710914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b330d-9255-474e-932d-b0e73de0d39f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:12.712345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 683/1356] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:12.717938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6be7-ca86-461a-9c06-d1fbc6ae1fec None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:12.718417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6be7-ca86-461a-9c06-d1fbc6ae1fec None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:12.718745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6be7-ca86-461a-9c06-d1fbc6ae1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:12.757577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:12.792350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-519c6be7-ca86-461a-9c06-d1fbc6ae1fec None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:12.793619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-519c6be7-ca86-461a-9c06-d1fbc6ae1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:12.905146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 674/1357] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:13.235695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:13.236224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:13.236783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:13.238703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 684/1358] 10.222.0.71 () {54 vars in 965 bytes} [Mon Sep 19 11:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:13.246718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801f25-0393-4c2d-89f9-681679c06853 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:13.247307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801f25-0393-4c2d-89f9-681679c06853 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:13.247791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801f25-0393-4c2d-89f9-681679c06853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:13.387439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1e801f25-0393-4c2d-89f9-681679c06853 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:13.389060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1e801f25-0393-4c2d-89f9-681679c06853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:13.444403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:13.532916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 675/1359] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Sep 19 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:13.535464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:13.537346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:13.697127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0445d0-3fc9-4eb1-821a-6a91f80fec7d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:13.817774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:13.875580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:13.876178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:13.876453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:13.876752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:13.878368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:13.977035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:13.978536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d2bce-8acd-4a18-ac66-47fdca874018 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:13.997462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 685/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:16.450891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:16.451408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:16.451516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:16.452801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 676/1361] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:16.458190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51071-7598-4a31-9bb2-1532594dc5de None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:16.459478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51071-7598-4a31-9bb2-1532594dc5de None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:16.459845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51071-7598-4a31-9bb2-1532594dc5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:16.530458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16f51071-7598-4a31-9bb2-1532594dc5de None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:16.531836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16f51071-7598-4a31-9bb2-1532594dc5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:16.572590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:16.638803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 686/1362] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:16.934560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:16.936175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:17.103412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bbf96-7213-43d2-9848-7202ee0b3438 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:17.113920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:17.226824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:17.227429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:17.227703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:17.227969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:17.230592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:17.324793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:17.326504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed227d-b768-4c04-abad-13dfaede9b73 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:17.345803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 677/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:19.862523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8382db-44c8-45e1-82a1-b28bab120d7c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:19.863063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8382db-44c8-45e1-82a1-b28bab120d7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:19.863063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8382db-44c8-45e1-82a1-b28bab120d7c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:19.865065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 687/1364] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:19.870639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fe8d-0910-4632-9d70-2dcc56bf77f9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:19.871102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fe8d-0910-4632-9d70-2dcc56bf77f9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:19.871186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fe8d-0910-4632-9d70-2dcc56bf77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:19.887965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:19.945193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3f80fe8d-0910-4632-9d70-2dcc56bf77f9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:19.946667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3f80fe8d-0910-4632-9d70-2dcc56bf77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:20.055610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 678/1365] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:20.350125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:20.350538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:20.350933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:20.352728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 688/1366] 10.222.0.71 () {54 vars in 965 bytes} [Mon Sep 19 11:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:20.358452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2336-e2a5-41ea-8681-ca894d1383d6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:20.358835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2336-e2a5-41ea-8681-ca894d1383d6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:20.359205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2336-e2a5-41ea-8681-ca894d1383d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:20.438488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c3ca2336-e2a5-41ea-8681-ca894d1383d6 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:20.439878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c3ca2336-e2a5-41ea-8681-ca894d1383d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:20.476823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:20.564989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 679/1367] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Sep 19 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:20.573671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:20.575207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:20.733562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829dd0c-d13c-44e7-a8db-0f352c5ad4c0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:20.755138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:20.857992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:20.858601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:20.858880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:20.859152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:20.860797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:20.965270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:20.966891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd085045-8ee3-4356-bae3-ad0123a17165 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:20.986161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 689/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:18:21.017873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a1b0-6b3f-4867-8d32-709a5add1e09 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:21.018435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a1b0-6b3f-4867-8d32-709a5add1e09 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:21.018435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a1b0-6b3f-4867-8d32-709a5add1e09 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:21.020154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 680/1369] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:21.026538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a5ed-f5d0-4b0d-860b-25193a3a235f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:21.026823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a5ed-f5d0-4b0d-860b-25193a3a235f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:21.027095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a5ed-f5d0-4b0d-860b-25193a3a235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:21.062101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:21.104659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-44e0a5ed-f5d0-4b0d-860b-25193a3a235f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:21.104659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-44e0a5ed-f5d0-4b0d-860b-25193a3a235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:21.234483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 690/1370] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:21.568919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:21.569808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:21.569808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:21.570980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 681/1371] 10.222.0.71 () {54 vars in 967 bytes} [Mon Sep 19 11:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:21.575877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965e40-1765-4c8c-ac2e-508388e3909a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:21.576168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965e40-1765-4c8c-ac2e-508388e3909a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:21.576442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965e40-1765-4c8c-ac2e-508388e3909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:21.657999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-25965e40-1765-4c8c-ac2e-508388e3909a None None] MFA Rules not processed for user `cdc5670d29254a6095b0469caf7b616f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:21.659204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-25965e40-1765-4c8c-ac2e-508388e3909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:21.710064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:21.751944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 691/1372] 10.222.0.71 () {58 vars in 1064 bytes} [Mon Sep 19 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:21.759825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:21.761354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:21.874152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6da1ae-a946-4446-9bc1-9ab6382cb2c0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:21.917218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:21.956839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:21.957865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:21.959088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:21.959595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:21.961919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:22.097683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:22.101075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48c69f-b47f-4c43-bf27-9e126e8238d1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:22.135944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 682/1373] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:23.247952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:23.248642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:23.248642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:23.249940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 692/1374] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:23.256171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73ad8-4e35-43b6-99b0-585760d59c61 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:23.256632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73ad8-4e35-43b6-99b0-585760d59c61 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:23.256848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba73ad8-4e35-43b6-99b0-585760d59c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:23.325841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6ba73ad8-4e35-43b6-99b0-585760d59c61 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:23.327036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6ba73ad8-4e35-43b6-99b0-585760d59c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:23.348294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:23.426897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 683/1375] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:23.721050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:23.722559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:23.879606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3a5b5-2fd0-4c6f-bb14-8c2cd9578e44 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:23.933885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:23.997318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:23.998074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:23.998074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:23.998253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:23.999717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:24.092661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:24.094125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c34cb1-d008-4b31-9b0b-61d36e8fa7e9 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:24.114408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 693/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:26.342473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:26.342985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:26.343101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:26.344343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 684/1377] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:26.350737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9a60-09da-44a9-a007-da6694d4fe39 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:26.351170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9a60-09da-44a9-a007-da6694d4fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:26.351274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9a60-09da-44a9-a007-da6694d4fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:26.419926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-66bc9a60-09da-44a9-a007-da6694d4fe39 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:26.421133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66bc9a60-09da-44a9-a007-da6694d4fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:26.428531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:26.530630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 694/1378] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:26.820373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:26.822033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:26.993637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e1a0-a419-4e49-9486-9f76ee1d2fd5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:26.997903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:27.123402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:27.124158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:27.124540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:27.124940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:27.126947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:27.236946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:27.239147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17974be1-de10-4f72-baf0-e9fbfd2adadd service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:27.262312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 685/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:29.502589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:29.503060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:29.503152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:29.504625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 695/1380] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:29.510782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40101e4-5d85-4a11-9b69-a5a10d64fade None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:29.511201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40101e4-5d85-4a11-9b69-a5a10d64fade None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:29.511920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40101e4-5d85-4a11-9b69-a5a10d64fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:29.523913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:29.598128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b40101e4-5d85-4a11-9b69-a5a10d64fade None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:29.600105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b40101e4-5d85-4a11-9b69-a5a10d64fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:29.731699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 686/1381] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:30.060375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:30.061950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:30.198056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:30.210946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcdff-b875-4c39-8a0c-06a236984faf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:30.337338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:30.337936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:30.338210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:30.338476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:30.340086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:30.432183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:30.434008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd71f-42a6-48eb-99b5-bcebf56a2f86 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:30.444844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:30.454131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 696/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:32.641922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:32.642719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:32.642719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:32.643813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 687/1383] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:32.649893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06006df-131d-44d5-9fdb-00c9db2ba49b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:32.650382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06006df-131d-44d5-9fdb-00c9db2ba49b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:32.650382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06006df-131d-44d5-9fdb-00c9db2ba49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:32.717986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d06006df-131d-44d5-9fdb-00c9db2ba49b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:32.719187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d06006df-131d-44d5-9fdb-00c9db2ba49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:32.817230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 697/1384] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:33.109724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:33.111253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:33.199879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:33.270812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc7dc-89b7-453d-9865-b4ab218aa7e5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:33.397227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:33.397820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:33.398482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:33.398821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:33.401073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:33.466396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:33.508997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:33.510614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790c12-c096-4940-b487-a807e6dab198 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:33.529197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 688/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:35.877810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:35.878470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:35.878470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:35.879702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 698/1386] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:35.885888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca8ac5-f00e-427d-86a6-64055d92a081 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:35.886357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca8ac5-f00e-427d-86a6-64055d92a081 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:35.886469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca8ac5-f00e-427d-86a6-64055d92a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:35.955214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5bca8ac5-f00e-427d-86a6-64055d92a081 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:35.956731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5bca8ac5-f00e-427d-86a6-64055d92a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:36.056359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 689/1387] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:36.344977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:36.346530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:36.426036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:36.496031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8086db-bc62-4dd3-83f9-d166a7d38adf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:36.617900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:36.618504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:36.618779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:36.619048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:36.620695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:36.662147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:36.721679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:36.723289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf996d-5d70-494d-b1cc-b3787d48528b service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:36.741485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 699/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:37.627117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965941-60e5-43f0-bea2-5d6aa5cfa1ac None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:37.627687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965941-60e5-43f0-bea2-5d6aa5cfa1ac None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:37.627687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965941-60e5-43f0-bea2-5d6aa5cfa1ac None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:37.629058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 690/1389] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:37.634658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055bdef-adaf-4a83-ad7a-3fb4441ba678 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:37.635129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055bdef-adaf-4a83-ad7a-3fb4441ba678 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:37.635237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055bdef-adaf-4a83-ad7a-3fb4441ba678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:37.704953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d055bdef-adaf-4a83-ad7a-3fb4441ba678 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:37.706528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d055bdef-adaf-4a83-ad7a-3fb4441ba678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:37.805725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 700/1390] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:38.106488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:38.106765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:38.107032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:38.108388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 691/1391] 10.222.0.71 () {54 vars in 962 bytes} [Mon Sep 19 11:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:38.113656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011981f7-d6ac-46fc-8092-e0ab4aff48f2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:38.113949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011981f7-d6ac-46fc-8092-e0ab4aff48f2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:38.114347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011981f7-d6ac-46fc-8092-e0ab4aff48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:38.131469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:38.193890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-011981f7-d6ac-46fc-8092-e0ab4aff48f2 None None] MFA Rules not processed for user `07e473709ec4428db98fb7cd9009d644`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:38.195103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-011981f7-d6ac-46fc-8092-e0ab4aff48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:38.275563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 701/1392] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Sep 19 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:38.284605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:38.286246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:38.319212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:38.396949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902613fd-2eed-46d3-9034-d0c4a115bad5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:38.473226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:38.473834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:38.474179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:38.474646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:38.476182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:38.557139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:38.590339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:38.591778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dad4c-1bf2-4892-a5cf-7ec789d22c19 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:38.611134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 692/1393] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:38.938695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffcb4-5571-48f1-8b49-b2edccb662d0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:38.939352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffcb4-5571-48f1-8b49-b2edccb662d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:38.939352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfffcb4-5571-48f1-8b49-b2edccb662d0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:38.940782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 702/1394] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:38.946523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:38.947001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:38.947102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.016961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:39.018595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:39.120259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 693/1395] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:39.372318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fe46-4b80-4bce-8fb7-44972cc4a4c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:39.372703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fe46-4b80-4bce-8fb7-44972cc4a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:39.373044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fe46-4b80-4bce-8fb7-44972cc4a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.428012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:39.429377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:39.446704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c3f3fe46-4b80-4bce-8fb7-44972cc4a4c6 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:39.447928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c3f3fe46-4b80-4bce-8fb7-44972cc4a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:39.470362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:39.504488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:39.541437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 703/1396] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:39.561805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249317e-927a-4a1d-a4a1-858455e06d15 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:39.589658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19104e9-2800-4c30-bb8f-6d5d7f0110c6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:39.589939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19104e9-2800-4c30-bb8f-6d5d7f0110c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:39.590664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19104e9-2800-4c30-bb8f-6d5d7f0110c6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.592006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 704/1397] 10.222.0.71 () {54 vars in 943 bytes} [Mon Sep 19 11:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:18:39.598458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:39.598842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:39.599827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.676429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] MFA Rules not processed for user `72e8f4cb893a4a119ffa520b2b7f6efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:39.677774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:39.679797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:39.680851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:39.681136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:39.681412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.683025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:39.719742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:39.777284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:39.778808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b063d-e151-49df-a7b3-f574144fbd46 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:39.789166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 705/1398] 10.222.0.71 () {58 vars in 1040 bytes} [Mon Sep 19 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:39.797168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 694/1399] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:18:39.798731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:39.809034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f754c8-f89e-47da-97c5-627312096f7c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:39.836913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:39.925015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:39.925637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:39.925909 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:39.926171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:39.928542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:40.022223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:40.023827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd94e49-0032-4f31-8a48-05ea0eb410fb service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:40.032470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 706/1400] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:18:42.007456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:42.008103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:42.008103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:42.009362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 695/1401] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:42.014793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b96b5-e8d3-4be7-87a3-f0e97800b271 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:42.015236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b96b5-e8d3-4be7-87a3-f0e97800b271 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:42.015338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b96b5-e8d3-4be7-87a3-f0e97800b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:42.090982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-806b96b5-e8d3-4be7-87a3-f0e97800b271 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:42.092278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-806b96b5-e8d3-4be7-87a3-f0e97800b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:42.099146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:42.200739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 707/1402] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:42.489283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:42.491498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:42.663971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f872ff4-66fb-4146-875c-33f4d560b04e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:42.678771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:42.794663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:42.795406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:42.795753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:42.796104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:42.797904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:42.902635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:42.904431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60575b-9f50-4349-90a1-cb0e033d44e7 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:42.924053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 696/1403] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:45.218263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:45.218263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:45.218263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:45.218263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 708/1404] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:45.219533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ed3dc-a994-439c-9ccb-629f60fbfcee None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:45.219533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ed3dc-a994-439c-9ccb-629f60fbfcee None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:45.219533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ed3dc-a994-439c-9ccb-629f60fbfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:45.234337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:45.298080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-582ed3dc-a994-439c-9ccb-629f60fbfcee None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:45.300865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-582ed3dc-a994-439c-9ccb-629f60fbfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:45.413258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 697/1405] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:45.706586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:45.708101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:45.870079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:45.887250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef9420-a69d-446a-888b-ae4101d0c6d9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:46.014037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:46.014553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:46.014826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:46.015089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:46.016763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:46.121341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:46.123232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76ddc-198d-47c9-81f7-d51ca62503ff service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:46.134140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:46.144237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 709/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:48.389014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:48.389552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:48.389552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:48.391095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 698/1407] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:18:48.398969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ab4c8-f626-4f66-938b-e9dfddbbcf8d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:48.398969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ab4c8-f626-4f66-938b-e9dfddbbcf8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:48.398969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ab4c8-f626-4f66-938b-e9dfddbbcf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:48.471932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7f6ab4c8-f626-4f66-938b-e9dfddbbcf8d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:48.473208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7f6ab4c8-f626-4f66-938b-e9dfddbbcf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:48.582936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 710/1408] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:48.879091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:48.881617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:48.994335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:49.060328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cbbda-0a03-48eb-bc95-2bad8a0368b6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:49.183891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:49.184408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:49.184714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:49.184976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:49.186595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:49.256654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:49.295421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:49.297077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40d5d4-63c2-421d-bcee-413814d97747 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:49.318667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 699/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:58.581570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=67 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:59.315562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=20 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:02.951817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d062f8-6905-48cd-81c4-0311c19f7cfe None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:02.952369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d062f8-6905-48cd-81c4-0311c19f7cfe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:02.952369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d062f8-6905-48cd-81c4-0311c19f7cfe None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:02.953759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 711/1410] 10.222.0.71 () {54 vars in 918 bytes} [Mon Sep 19 11:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:02.958931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6b07-46f5-4e46-a3ab-3edccbf6166a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:02.959405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6b07-46f5-4e46-a3ab-3edccbf6166a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:02.959509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6b07-46f5-4e46-a3ab-3edccbf6166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:03.037053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f52e6b07-46f5-4e46-a3ab-3edccbf6166a None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:03.038420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f52e6b07-46f5-4e46-a3ab-3edccbf6166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:03.142369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 700/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Sep 19 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:03.157228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172a34-c4ea-422b-befc-be8e5aab846d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:03.157513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172a34-c4ea-422b-befc-be8e5aab846d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:03.157783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec172a34-c4ea-422b-befc-be8e5aab846d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:03.159115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 712/1412] 10.222.0.71 () {54 vars in 918 bytes} [Mon Sep 19 11:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:03.164473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfe03-1382-40b3-88e7-a18ccc788da0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:03.164790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfe03-1382-40b3-88e7-a18ccc788da0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:03.165063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfe03-1382-40b3-88e7-a18ccc788da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:03.237428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:03.241089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-127dfe03-1382-40b3-88e7-a18ccc788da0 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:03.242679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-127dfe03-1382-40b3-88e7-a18ccc788da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:03.359439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 701/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Sep 19 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:06.079724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:06.080326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:06.080500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:06.081876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:06.088671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b046-61bb-442c-96c6-de5d76285d46 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:06.095411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b046-61bb-442c-96c6-de5d76285d46 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:06.095863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b046-61bb-442c-96c6-de5d76285d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:06.161311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-72a0b046-61bb-442c-96c6-de5d76285d46 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:06.162611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-72a0b046-61bb-442c-96c6-de5d76285d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:06.219609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:06.261699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:19:06.558967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:06.560602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:06.704170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd84e84-7bc9-421b-88b1-5473e6e7dc14 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:06.778928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:06.820003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946265b-b938-4691-8612-48936f20d423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:06.820522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946265b-b938-4691-8612-48936f20d423 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:06.820828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946265b-b938-4691-8612-48936f20d423 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:06.821096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946265b-b938-4691-8612-48936f20d423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:06.822715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8946265b-b938-4691-8612-48936f20d423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:06.911619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946265b-b938-4691-8612-48936f20d423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:06.913232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946265b-b938-4691-8612-48936f20d423 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:06.931267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 714/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:08.099924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:08.100516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:08.100516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:08.101823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:08.108275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e037c5-3d17-41f3-9eaa-f97e7847b1ea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:08.108753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e037c5-3d17-41f3-9eaa-f97e7847b1ea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:08.108886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e037c5-3d17-41f3-9eaa-f97e7847b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:08.184892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-84e037c5-3d17-41f3-9eaa-f97e7847b1ea None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:08.186090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-84e037c5-3d17-41f3-9eaa-f97e7847b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:08.214786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:08.285669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:08.435137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:08.436607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:08.581516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088723-2b62-4ea7-96b9-2736e9ab31d4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:08.621477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:08.694393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:08.694909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:08.695191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:08.695460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:08.697091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:08.786282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:08.788495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c336-2079-4f60-a0a4-2889ccbcab14 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:08.806761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 704/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:09.966069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:09.966663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:09.966663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:09.967959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:09.974721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c1de-73c0-420b-bb44-eef043220be4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:09.975171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c1de-73c0-420b-bb44-eef043220be4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:09.975349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c1de-73c0-420b-bb44-eef043220be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:10.029440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:10.052373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1a45c1de-73c0-420b-bb44-eef043220be4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:10.053707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1a45c1de-73c0-420b-bb44-eef043220be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:10.150291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:10.306212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:10.307747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:10.465650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109a4c-7d20-414d-bb24-00ef25d03cb6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:10.478152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:10.578372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:10.578907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:10.579180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:10.579443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:10.581059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:10.674400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:10.675976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c8384-8dff-4b2e-9672-3f3e53e673fd service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:10.694354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 717/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:11.797860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:11.798383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:11.798383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:11.800376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:11.806262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde55e-9d7e-49a2-a0b3-0a6cd7f022cc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:11.806704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde55e-9d7e-49a2-a0b3-0a6cd7f022cc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:11.806799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fde55e-9d7e-49a2-a0b3-0a6cd7f022cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:11.827378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:11.884308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-63fde55e-9d7e-49a2-a0b3-0a6cd7f022cc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:11.886279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-63fde55e-9d7e-49a2-a0b3-0a6cd7f022cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:11.993572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:12.147463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:12.148952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:12.258425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:12.295116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7abe-c2e3-4049-a270-301bab4cabd5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:12.408897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:12.409423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:12.409703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:12.409971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:12.411611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:12.498487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:12.512208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:12.513860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5839511-9a1e-4e32-a12d-dce2ecc316aa service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:12.531699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 707/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:13.655744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:13.656281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:13.656281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:13.657683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:13.664244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863970bf-951c-4064-806a-8109160acfb2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:13.664699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863970bf-951c-4064-806a-8109160acfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:13.664863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863970bf-951c-4064-806a-8109160acfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:13.741239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-863970bf-951c-4064-806a-8109160acfb2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:13.742454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-863970bf-951c-4064-806a-8109160acfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:13.842033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:13.994138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:13.995584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:14.081518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:14.143907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e80f-d4e4-426c-8abf-eefc9daed78b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:14.258204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:14.258746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:14.259008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:14.259276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:14.260933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:14.309796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:14.350765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:14.352346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a85760-eaff-4296-9475-db79a2b04905 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:14.372541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 720/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:19:15.494874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:15.495407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:15.495407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:15.496678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:15.502754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6418db-5186-4a75-a953-0b0e97895d71 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:15.503164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6418db-5186-4a75-a953-0b0e97895d71 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:15.503299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6418db-5186-4a75-a953-0b0e97895d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:15.593497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2b6418db-5186-4a75-a953-0b0e97895d71 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:15.594705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b6418db-5186-4a75-a953-0b0e97895d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:15.699994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:15.868597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:15.870153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:15.919197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:16.016306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5861f-2eb0-4715-a36c-6e09381acf95 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:16.134368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:16.134881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:16.135157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:16.135494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:16.137372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:16.144246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:16.227359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:16.228993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0257c6-a36b-4c36-bc4a-f643bee561ff service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:16.247596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 710/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:17.319098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:17.319676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:17.319676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:17.321012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:17.327143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de1a1-52dc-45a2-aea3-f017a74d1fbe None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:17.327587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de1a1-52dc-45a2-aea3-f017a74d1fbe None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:17.327682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de1a1-52dc-45a2-aea3-f017a74d1fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:17.403595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-275de1a1-52dc-45a2-aea3-f017a74d1fbe None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:17.404833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-275de1a1-52dc-45a2-aea3-f017a74d1fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:17.471939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:17.501290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:17.654964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:17.656488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:17.674982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:17.804151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553ed1d-bbe6-4d75-ad9c-05a4768b0fd8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:17.892427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:17.918647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:17.919248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:17.919523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:17.919789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:17.921432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:18.009361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:18.010949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2b67-af7a-4aad-b0e6-996434b423cf service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:18.029488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 723/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:19.094888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:19.095414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:19.095538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:19.096847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:19.103634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0211-21b9-4bd5-a6c8-621bfb9680bb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:19.104060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0211-21b9-4bd5-a6c8-621bfb9680bb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:19.104264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0211-21b9-4bd5-a6c8-621bfb9680bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:19.179387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-891f0211-21b9-4bd5-a6c8-621bfb9680bb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:19.180619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-891f0211-21b9-4bd5-a6c8-621bfb9680bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:19.223081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:19.278174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:19.426618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:19.428999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:19.574420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc26c-b8e4-4b0d-9f57-913ec6249560 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:19.628325 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:19.688168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:19.688717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:19.688990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:19.689255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:19.690846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:19.783017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:19.784628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86af735-cab2-49e4-90cd-916cc27e7f49 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:19.802986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 713/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:20.874301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:20.874878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:20.874878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:20.876175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:20.883958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871753e1-3f2d-42e5-b6df-d0ff3912e1ed None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:20.884462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871753e1-3f2d-42e5-b6df-d0ff3912e1ed None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:20.884570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871753e1-3f2d-42e5-b6df-d0ff3912e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:20.961513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-871753e1-3f2d-42e5-b6df-d0ff3912e1ed None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:20.962726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-871753e1-3f2d-42e5-b6df-d0ff3912e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:20.964771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:21.059822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:21.217379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:21.217379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:21.363310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec908b4-41d6-4d76-ae83-f3bb683aa458 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:21.391285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:21.477781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:21.478300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:21.478575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:21.478844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:21.480472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:21.572250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:21.573873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049de730-be90-4078-8c7a-3eaf4bcd2c1c service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:21.593026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 726/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:23.672003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:23.672647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:23.672647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:23.673972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:23.679836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6aec-939d-4cd0-97f2-43723d303681 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:23.680312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6aec-939d-4cd0-97f2-43723d303681 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:23.680416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6aec-939d-4cd0-97f2-43723d303681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:23.720923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:23.747527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3f2b6aec-939d-4cd0-97f2-43723d303681 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:23.748771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f2b6aec-939d-4cd0-97f2-43723d303681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:23.843620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:24.127690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:24.129283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:24.234868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912db2d9-a512-47f4-8396-b5f3afc6e60c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:24.267368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:24.312370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:24.313003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:24.313283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:24.313552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:24.315152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:24.424303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:24.425689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413c6b7-e49b-4857-8feb-0ba913ea2a14 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:24.443755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 716/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:26.746101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:26.746661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:26.746661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:26.747993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:26.753385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e8ee-f036-460c-b07e-ae06174e3e8b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:26.753812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e8ee-f036-460c-b07e-ae06174e3e8b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:26.753944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e8ee-f036-460c-b07e-ae06174e3e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:26.823214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7500e8ee-f036-460c-b07e-ae06174e3e8b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:26.824432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7500e8ee-f036-460c-b07e-ae06174e3e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:26.837879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:26.924443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:27.207413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:27.209036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:27.312471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf1d3-2b34-4ce2-8945-5e762a6073f9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:27.326248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:27.387775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:27.388362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:27.388667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:27.388940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:27.390539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:27.499462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:27.500834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e6b59-3e4a-432e-a2cb-05987b251afb service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:27.519251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 729/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:29.976097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:29.976708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:29.976708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:29.978016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:29.983588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c150-82d5-47ec-b1f9-f5260491b295 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:29.983986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c150-82d5-47ec-b1f9-f5260491b295 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:29.984135 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2c150-82d5-47ec-b1f9-f5260491b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:30.032249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:30.050916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-32f2c150-82d5-47ec-b1f9-f5260491b295 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:30.052789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-32f2c150-82d5-47ec-b1f9-f5260491b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:30.147397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:30.437730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:30.439253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:30.542323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c5ed-10c2-4a64-90c4-e5610f11ec7a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:30.581579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:30.615681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:30.616277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:30.616552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:30.616852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:30.618434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:30.726748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:30.728099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d256e-5762-415e-87bb-48fdb6b6a760 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:30.747186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 719/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:33.063668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:33.064252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:33.064252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:33.065569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:33.070987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38584-0a98-481f-a856-c8fdff18d843 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:33.071378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38584-0a98-481f-a856-c8fdff18d843 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:33.071565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38584-0a98-481f-a856-c8fdff18d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:33.137701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5fb38584-0a98-481f-a856-c8fdff18d843 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:33.138922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5fb38584-0a98-481f-a856-c8fdff18d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:33.159751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:33.238540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:33.526631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:33.528225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:33.631604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdafea8-2816-4e27-98c7-54051c2f752d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:33.651910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:33.705367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:33.705965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:33.706243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:33.706515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:33.708122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:33.817438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:33.819108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af57f6-603a-42db-8514-ab20c2434f69 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:33.837138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 732/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:36.041810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:36.042386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:36.042386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:36.043695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:36.049075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92998a6-4e14-46a7-a9a3-f10f219a8470 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:36.049523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92998a6-4e14-46a7-a9a3-f10f219a8470 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:36.049629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92998a6-4e14-46a7-a9a3-f10f219a8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:36.113352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:36.116656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d92998a6-4e14-46a7-a9a3-f10f219a8470 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:36.118434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d92998a6-4e14-46a7-a9a3-f10f219a8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:36.214895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:36.517990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:36.519549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:36.622557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7e1f-da30-4c94-bf4f-e4353bf42ec3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:36.672003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:36.697817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:36.698429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:36.698711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:36.698982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:36.700651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:36.825368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:36.826812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19d6d8-fc55-4dde-b63d-d8dddef6f879 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:36.844657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 722/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:39.076974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:39.077522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:39.077522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:39.078887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:39.085295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d6c3-4611-4d05-b8bb-124e97502f2a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:39.085715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d6c3-4611-4d05-b8bb-124e97502f2a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:39.085844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19d6c3-4611-4d05-b8bb-124e97502f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:39.153174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4e19d6c3-4611-4d05-b8bb-124e97502f2a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:39.154378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4e19d6c3-4611-4d05-b8bb-124e97502f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:39.184229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:39.254684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:39.537365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:39.539001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:39.641324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824387a-16a7-479d-970b-d9cecfd7450b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:39.669959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:39.714828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:39.715425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:39.715701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:39.715970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:39.717603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:39.836791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:39.838220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1061-d1c4-44a1-b270-f5ee726b9965 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:39.857624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 735/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:42.094949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:42.095518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:42.095518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:42.096849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:42.102293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e9d-0ece-4919-88b3-c2f2d90c52e3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:42.102742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e9d-0ece-4919-88b3-c2f2d90c52e3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:42.102855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e9d-0ece-4919-88b3-c2f2d90c52e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:42.167928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ed3a0e9d-0ece-4919-88b3-c2f2d90c52e3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:42.169089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed3a0e9d-0ece-4919-88b3-c2f2d90c52e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:42.178263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:42.267066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:42.552510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:42.554149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:42.657515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7291c-012e-44fd-a327-9cd0692fc219 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:42.712807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:42.731119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:42.731974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:42.732248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:42.732515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:42.734120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:42.844602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:42.845961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c833c9-e3d5-4d08-a139-0e12c4e426ab service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:42.869475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 725/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:45.081692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:45.082237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:45.082237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:45.083686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:45.089046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b512-c0df-4128-8832-967a19f0b894 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:45.089431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b512-c0df-4128-8832-967a19f0b894 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:45.089596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b512-c0df-4128-8832-967a19f0b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:45.155110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-86c3b512-c0df-4128-8832-967a19f0b894 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:45.156314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86c3b512-c0df-4128-8832-967a19f0b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:45.194845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:45.254984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:45.542543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:45.544123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:45.645313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858ce6-376c-4881-8d70-7305e66beb98 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:45.683646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:45.718845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:45.719442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:45.719714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:45.719978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:45.721605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:45.830083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:45.831503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1feee-9847-4d0e-a63a-5a9fc0a3ee2f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:45.851229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 738/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:48.027972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:48.028516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:48.028516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:48.029896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:48.035283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52693c-d3d8-4b28-9cdc-2238995b1050 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:48.035683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52693c-d3d8-4b28-9cdc-2238995b1050 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:48.035819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52693c-d3d8-4b28-9cdc-2238995b1050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:48.100811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8d52693c-d3d8-4b28-9cdc-2238995b1050 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:48.102012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d52693c-d3d8-4b28-9cdc-2238995b1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:48.120703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:48.197905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:48.480947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:48.482738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:48.585285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa75e8-8af8-4719-bb19-76fe82a930e9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:48.773175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:48.780212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:48.780870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:48.781144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:48.781437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:48.783045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:48.893655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:48.895079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cd292-06e8-4240-a967-312542004736 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:48.913672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 728/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:51.151111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:51.151646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:51.151646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:51.152931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:51.158268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b3734-1ee1-4fc4-8e84-176b5c48569f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:51.158670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b3734-1ee1-4fc4-8e84-176b5c48569f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:51.158814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b3734-1ee1-4fc4-8e84-176b5c48569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:51.224672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6a6b3734-1ee1-4fc4-8e84-176b5c48569f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:51.225872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a6b3734-1ee1-4fc4-8e84-176b5c48569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:51.273658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:51.321087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:51.601853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:51.603385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:51.705850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5487e-1ba0-4cf5-b636-752094ac3920 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:51.753999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:51.779101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:51.779694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:51.779971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:51.780240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:51.781873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:51.901478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:51.903160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929209c-068a-4f55-a245-e13153e88c64 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:51.930226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 741/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:01.319576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=22 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:01.927992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=66 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:12.027296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921497a-28dc-41e2-b758-fc8715a9ed7b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.027834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921497a-28dc-41e2-b758-fc8715a9ed7b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.027834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921497a-28dc-41e2-b758-fc8715a9ed7b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.029214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 730/1471] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:12.034494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cdae0-2d5c-48da-ab59-2dd8c53d2b19 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.034922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cdae0-2d5c-48da-ab59-2dd8c53d2b19 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.035031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cdae0-2d5c-48da-ab59-2dd8c53d2b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.102374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b15cdae0-2d5c-48da-ab59-2dd8c53d2b19 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:12.103598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b15cdae0-2d5c-48da-ab59-2dd8c53d2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.200779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 742/1472] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:12.508889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.509171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.509444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.510803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 731/1473] 10.222.0.71 () {54 vars in 962 bytes} [Mon Sep 19 11:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:12.515764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509bee3-035c-47ba-80c8-a09ea286b518 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.516047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509bee3-035c-47ba-80c8-a09ea286b518 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.516311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509bee3-035c-47ba-80c8-a09ea286b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.592630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6509bee3-035c-47ba-80c8-a09ea286b518 None None] MFA Rules not processed for user `07e473709ec4428db98fb7cd9009d644`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:12.593879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6509bee3-035c-47ba-80c8-a09ea286b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.615936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:12.670207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 743/1474] 10.222.0.71 () {58 vars in 1059 bytes} [Mon Sep 19 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:12.678612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:12.680182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.783043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c7b70-3aab-4b77-8ca5-a9eeba499e77 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:12.858929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:12.859562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.859840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.860126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.861770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.915873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:12.969760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:12.971196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332e554-1c1c-4bea-b6d2-ec59d9daeed4 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:12.990347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 732/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:15.225823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.226309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.226412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.227723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 744/1476] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:15.233320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083212b9-ab8a-49cf-bcb7-fe1b9249572c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.233727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083212b9-ab8a-49cf-bcb7-fe1b9249572c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.233844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083212b9-ab8a-49cf-bcb7-fe1b9249572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.298985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-083212b9-ab8a-49cf-bcb7-fe1b9249572c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:15.300175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-083212b9-ab8a-49cf-bcb7-fe1b9249572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:15.394445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 733/1477] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:15.666076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:15.667608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:15.791171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ff33-e26f-4f7b-84b1-66020ddf0592 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:15.840758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:15.885783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:15.886379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.886652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.886916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.887544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:15.889317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:20:15.889317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:20:15.889317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:20:15.890441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b59f-4916-4744-b53f-850d7493fca7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:15.908830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 745/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Mon Sep 19 11:20:15 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:18.113274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:18.113814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:18.113814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:18.115447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 734/1479] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:18.120824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a61ea-567f-409a-a885-b25a41386c17 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:18.121262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a61ea-567f-409a-a885-b25a41386c17 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:18.121378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a61ea-567f-409a-a885-b25a41386c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:18.194769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d06a61ea-567f-409a-a885-b25a41386c17 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:18.195961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d06a61ea-567f-409a-a885-b25a41386c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:18.293281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 746/1480] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:18.589205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:18.590727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:18.600660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:18.741754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f08e-6472-4b29-8c7f-914216d81304 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:18.822840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:18.854847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:18.855440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:18.855710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:18.855972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:18.857832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:18.946514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:18.948087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662afc11-4160-4233-b3f0-14ddbd2add12 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:18.965627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 735/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:21.362583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:21.363141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:21.363141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:21.364488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 747/1482] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:21.369837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63542ad8-2241-47b9-afee-0662798f8797 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:21.370298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63542ad8-2241-47b9-afee-0662798f8797 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:21.370397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63542ad8-2241-47b9-afee-0662798f8797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:21.437243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63542ad8-2241-47b9-afee-0662798f8797 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:21.438443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63542ad8-2241-47b9-afee-0662798f8797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:21.484888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:21.534497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 736/1483] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:21.827208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:21.828782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:21.853634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:21.933981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169f07-daad-4b15-9b3b-fb1b13ec9346 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:22.007288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:22.007884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:22.008167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:22.008436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:22.010071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:22.083639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:22.118816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:22.120236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c2f1-aa30-47b5-ac98-0a81f0b6cbef service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:22.254314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 748/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:24.478158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:24.478729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:24.478729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:24.479969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 737/1485] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:24.485343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa185b-4406-42de-bdce-b3f6eb4ae6ec None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:24.485787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa185b-4406-42de-bdce-b3f6eb4ae6ec None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:24.485890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa185b-4406-42de-bdce-b3f6eb4ae6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:24.550582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8dfa185b-4406-42de-bdce-b3f6eb4ae6ec None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:24.551776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8dfa185b-4406-42de-bdce-b3f6eb4ae6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:24.650806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 749/1486] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:24.938453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:24.939978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:25.043507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80d71-9d01-40b9-9de0-d14025e29536 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:25.114864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:25.116340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:25.116978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:25.117612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:25.117999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:25.120040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:25.227928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:25.229390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4de530-3afd-408e-b9c5-8e763dff822e service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:25.247555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 738/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:27.497872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:27.498415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:27.498415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:27.499667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 750/1488] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:27.505037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c4f9-9f8b-4007-b315-8de58d139ceb None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:27.505536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c4f9-9f8b-4007-b315-8de58d139ceb None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:27.505654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c4f9-9f8b-4007-b315-8de58d139ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:27.570746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2391c4f9-9f8b-4007-b315-8de58d139ceb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:27.571946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2391c4f9-9f8b-4007-b315-8de58d139ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:27.623934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:27.668023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 739/1489] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:27.964033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:27.965607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:28.002326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:28.068822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459f7c-2081-4697-907f-58dcdec200f0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:28.140472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:28.141086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:28.141360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:28.141628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:28.143214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:28.224474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:28.253220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:28.254633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad4832-9237-4117-a7b3-abeeb6571345 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:28.274748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 751/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:30.695964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:30.696546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:30.696546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:30.697862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 740/1491] 10.222.0.71 () {54 vars in 927 bytes} [Mon Sep 19 11:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:20:30.703041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702352-ae81-4cfa-b4be-b48a9cadb455 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:30.703465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702352-ae81-4cfa-b4be-b48a9cadb455 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:30.703612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702352-ae81-4cfa-b4be-b48a9cadb455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:30.768980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ac702352-ae81-4cfa-b4be-b48a9cadb455 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:30.770190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ac702352-ae81-4cfa-b4be-b48a9cadb455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:30.868989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 752/1492] 10.222.0.71 () {58 vars in 1024 bytes} [Mon Sep 19 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:31.157646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:31.159283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:31.265191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29525ef0-0bd8-47c9-8fb8-0fd87f8a6221 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:31.339581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:31.340182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:31.340455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:31.340762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:31.342339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:31.351028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:31.449327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:31.450651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208738a-45df-48f6-b9fc-d35c482406f9 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:31.468681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 741/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:40.867343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:41.466537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=50 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:45.030080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.030693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.030693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.105961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:45.107153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.207502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 753/1494] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:45.216101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.216526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.216681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.291653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:45.292895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.388841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 742/1495] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:45.393512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.394712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.406584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129aec-7095-48d9-ae96-97c566cc3f49 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.470316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:45.505877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.506469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.506747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.507014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.507648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:45.507946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.508982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:45.508982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:21:45.508982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:21:45.509854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.522368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 754/1496] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:45.530792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.541105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0467c3-21af-4bd4-b28a-327eaae295a6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.602751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:45.637791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.638389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.638664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.638930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.639556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.641312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:45.641312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:21:45.641312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:21:45.642488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.700122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 743/1497] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:45 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:45.704373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.705962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.741123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb467-125b-4d70-943e-552a33e25fab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.830583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.831170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.831444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.831712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.832320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.833362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:45.833362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:21:45.833362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:21:45.835072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.878689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 755/1498] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:45 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:45.883008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.884518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.946465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb433-0f68-46dc-8558-d6ed122d68f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.028816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.039935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.040538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.040846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.041116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.041753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.042775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:46.042775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:21:46.042775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:21:46.043657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.055847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 744/1499] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:46.060082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:46.061635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.073237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81ba4-ce35-45a1-b3ff-842128cb923d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.097819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.167748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.168273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.168550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.168853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.169486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.170487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:46.170487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:21:46.170487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:21:46.171365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b92c0-fed4-489a-9e66-e3258c70ce12 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.183974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 756/1500] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:46.188326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:46.189951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.223413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c0f-b577-4920-87bc-c74cdb9377d6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.317744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.318401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.318680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.318950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] PATH_INFO: `/v3/projects/d993709d0a72403eb9787be4fc69804e/users/9838e30f7f524201aab36f2a6cafe5c1/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.341320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d993709d0a72403eb9787be4fc69804e, user_id=9838e30f7f524201aab36f2a6cafe5c1, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.342356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:46.342356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:21:46.342356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:21:46.344301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ded1d-a0ad-4e72-9437-d1208c0b923c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.369121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 745/1501] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:46 2022] PUT /identity/v3/projects/d993709d0a72403eb9787be4fc69804e/users/9838e30f7f524201aab36f2a6cafe5c1/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:46.381356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12972ea-8192-469a-a286-db7d95fc8122 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.381648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12972ea-8192-469a-a286-db7d95fc8122 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.381947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12972ea-8192-469a-a286-db7d95fc8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.438665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b12972ea-8192-469a-a286-db7d95fc8122 None None] MFA Rules not processed for user `9838e30f7f524201aab36f2a6cafe5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:46.439880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b12972ea-8192-469a-a286-db7d95fc8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.518287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 757/1502] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:46.531777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.532064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.532332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.533699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 746/1503] 10.222.0.71 () {54 vars in 967 bytes} [Mon Sep 19 11:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:21:46.539264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94756a-95f5-49c8-9580-015ba8e31370 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.539551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94756a-95f5-49c8-9580-015ba8e31370 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.539824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94756a-95f5-49c8-9580-015ba8e31370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.570743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.616377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7d94756a-95f5-49c8-9580-015ba8e31370 None None] MFA Rules not processed for user `cdc5670d29254a6095b0469caf7b616f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:46.617634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d94756a-95f5-49c8-9580-015ba8e31370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.692016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 758/1504] 10.222.0.71 () {58 vars in 1064 bytes} [Mon Sep 19 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:46.700415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:46.702054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.751155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.805297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bf17-fd43-4e23-8cb2-0e0fc06c2876 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.879834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.880990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.881264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.881529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.883127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.980679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.982083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.985839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.001239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 747/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:47.046132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffe40-e7b1-4da2-8201-4138d204c616 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.046414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffe40-e7b1-4da2-8201-4138d204c616 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.046681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ffe40-e7b1-4da2-8201-4138d204c616 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.047922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 759/1506] 10.222.0.71 () {52 vars in 830 bytes} [Mon Sep 19 11:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:21:47.051584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.053406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.150073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5335-70f2-4190-afaf-bbbfd1dd2207 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.242201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.242752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.242996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.243258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] PATH_INFO: `/v3/users/9838e30f7f524201aab36f2a6cafe5c1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.257177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9838e30f7f524201aab36f2a6cafe5c1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.258215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:47.258215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:21:47.258215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:21:47.259494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.269163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.328205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9838e30f7f524201aab36f2a6cafe5c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:47.343183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9838e30f7f524201aab36f2a6cafe5c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:47.365946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9838e30f7f524201aab36f2a6cafe5c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:47.366512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9838e30f7f524201aab36f2a6cafe5c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:47.366935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9838e30f7f524201aab36f2a6cafe5c1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:47.382388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 748/1507] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:47 2022] DELETE /identity/v3/users/9838e30f7f524201aab36f2a6cafe5c1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:47.386780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.387254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.387349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.443680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:47.444915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.519172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.532351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 760/1508] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:47.542482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.543722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.641950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ebb01-7f9c-4474-933a-a2461eed68b6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.696458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.717287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.717905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.718183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.718452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.720042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.829958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.831492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef1fca-2014-4ef6-82ef-dda0e464f42a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.851466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 749/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:48.209838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:48.211819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:48.226326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a08d-aa62-4e34-b6d9-791fd4377783 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:48.324411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:48.325055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:48.325328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:48.325593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] PATH_INFO: `/v3/projects/d993709d0a72403eb9787be4fc69804e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:48.335231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d993709d0a72403eb9787be4fc69804e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:48.336241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:21:48.336241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:21:48.336241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:21:48.337507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:48.394663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd993709d0a72403eb9787be4fc69804e', 'request_id': 'req-8b52454b-8c4b-42b5-98ca-f44c375e2467'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.408723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd993709d0a72403eb9787be4fc69804e', 'request_id': 'req-8b52454b-8c4b-42b5-98ca-f44c375e2467'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.415136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd993709d0a72403eb9787be4fc69804e', 'request_id': 'req-8b52454b-8c4b-42b5-98ca-f44c375e2467'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.441247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] The token cache is being invalidate because project d993709d0a72403eb9787be4fc69804e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:48.441531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.442041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8b52454b-8c4b-42b5-98ca-f44c375e2467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.443450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 761/1510] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:48 2022] DELETE /identity/v3/projects/d993709d0a72403eb9787be4fc69804e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:57.848804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=62 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:58.439157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:30.134949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:30.135572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:30.135572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:30.136943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:30.141679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402fe84-f065-4ba4-bfce-c5445c505960 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:30.142132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402fe84-f065-4ba4-bfce-c5445c505960 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:30.142248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402fe84-f065-4ba4-bfce-c5445c505960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:30.231025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b402fe84-f065-4ba4-bfce-c5445c505960 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:30.232232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b402fe84-f065-4ba4-bfce-c5445c505960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:30.334948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:30.498330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:30.500558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:30.623137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef685b8c-baab-4283-8fc7-6e1d325d6a71 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:30.628604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:30.629214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:30.629493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:30.629769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:30.638476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:30.640062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df805585-62e8-4adf-b936-c9bf4bd6507e service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:30.650086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 751/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:31.736171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea56da-ddfe-4f3d-898c-1d9234f6c2bd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.736793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea56da-ddfe-4f3d-898c-1d9234f6c2bd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.736793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea56da-ddfe-4f3d-898c-1d9234f6c2bd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.738460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:31.744953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4be2-16c6-4530-b91c-826977ac1fd8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.745470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4be2-16c6-4530-b91c-826977ac1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.745577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4be2-16c6-4530-b91c-826977ac1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.764944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-225e4be2-16c6-4530-b91c-826977ac1fd8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:31.766142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-225e4be2-16c6-4530-b91c-826977ac1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:31.774604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:31.940712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea56da-ddfe-4f3d-898c-1d9234f6c2bd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.956199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea56da-ddfe-4f3d-898c-1d9234f6c2bd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.962040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.962627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.962926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.963198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.971277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.972915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f408f-bb4d-4fc3-ba4b-fb017061c3ab service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.983081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 764/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:32.373124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a942c9-6f47-44c9-8b2d-1068926966dd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:32.373537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a942c9-6f47-44c9-8b2d-1068926966dd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:32.373856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a942c9-6f47-44c9-8b2d-1068926966dd None None] PATH_INFO: `/v3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:32.375183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 753/1517] 10.222.0.82 () {54 vars in 925 bytes} [Mon Sep 19 11:23:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:23:32.385078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5763c5-4b7a-4ef1-8d46-c4f4e2719150 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:32.385361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5763c5-4b7a-4ef1-8d46-c4f4e2719150 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:32.385634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5763c5-4b7a-4ef1-8d46-c4f4e2719150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:32.445771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-df5763c5-4b7a-4ef1-8d46-c4f4e2719150 None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:32.446978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-df5763c5-4b7a-4ef1-8d46-c4f4e2719150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:32.464643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:32.521763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 765/1518] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Sep 19 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:36.262265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b6d6-e337-4a59-87dc-fb39894d7e88 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:36.262732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b6d6-e337-4a59-87dc-fb39894d7e88 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:36.262840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504b6d6-e337-4a59-87dc-fb39894d7e88 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:36.264141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 754/1519] 10.222.0.71 () {54 vars in 961 bytes} [Mon Sep 19 11:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:36.269104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6d95-5783-4a0c-927c-bd7beeea03d0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:36.269635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6d95-5783-4a0c-927c-bd7beeea03d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:36.269635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6d95-5783-4a0c-927c-bd7beeea03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:36.290278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-060e6d95-5783-4a0c-927c-bd7beeea03d0 None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:36.291470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-060e6d95-5783-4a0c-927c-bd7beeea03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:36.299958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 766/1520] 10.222.0.71 () {58 vars in 1058 bytes} [Mon Sep 19 11:23:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:23:36.308462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504b6d6-e337-4a59-87dc-fb39894d7e88 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:36.322353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504b6d6-e337-4a59-87dc-fb39894d7e88 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:36.327566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:36.328158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:36.328437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:36.328743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:36.338165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:36.339755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2382cf-b184-4612-a844-8064fbf441d0 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:36.349911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 755/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:43.518411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126192c-513e-49b7-90bd-7242997be1ad None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:43.518941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126192c-513e-49b7-90bd-7242997be1ad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:43.518941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126192c-513e-49b7-90bd-7242997be1ad None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:43.520214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:43.527585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656d51-cc5e-4650-8bc0-e7bc6178f58b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:43.528048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656d51-cc5e-4650-8bc0-e7bc6178f58b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:43.528162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656d51-cc5e-4650-8bc0-e7bc6178f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:43.547277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e9656d51-cc5e-4650-8bc0-e7bc6178f58b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:43.548568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e9656d51-cc5e-4650-8bc0-e7bc6178f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:43.556468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:43.709075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126192c-513e-49b7-90bd-7242997be1ad None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:43.724208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126192c-513e-49b7-90bd-7242997be1ad None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:43.730380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:43.730962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:43.731236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:43.731503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:43.739605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:43.741752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27f0d6-ac29-455f-ae88-59e112635863 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:43.750977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 768/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:44.849326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676179-cf11-4bff-b98d-368ddbac2717 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:44.849884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676179-cf11-4bff-b98d-368ddbac2717 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:44.849884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676179-cf11-4bff-b98d-368ddbac2717 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:44.851951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:44.858523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9396-1b9d-44d4-96c8-b983933ad1dc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:44.859051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9396-1b9d-44d4-96c8-b983933ad1dc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:44.859149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9396-1b9d-44d4-96c8-b983933ad1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:44.879723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7f7e9396-1b9d-44d4-96c8-b983933ad1dc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:44.881014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7f7e9396-1b9d-44d4-96c8-b983933ad1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:44.889116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:45.042766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676179-cf11-4bff-b98d-368ddbac2717 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:45.058106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676179-cf11-4bff-b98d-368ddbac2717 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:45.063707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:45.064303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:45.064637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:45.064917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:45.074294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:45.075880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7985-9ea5-4111-ae74-f8c2e58908e4 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:45.085764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 758/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:49.141866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:49.142436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:49.142436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:49.143653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:49.149870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0d3a-0e16-49ad-823e-1984e9a21255 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:49.150313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0d3a-0e16-49ad-823e-1984e9a21255 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:49.150423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b0d3a-0e16-49ad-823e-1984e9a21255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:49.170500 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b34b0d3a-0e16-49ad-823e-1984e9a21255 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:49.171681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b34b0d3a-0e16-49ad-823e-1984e9a21255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:49.179615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:49.477490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:49.479178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:49.557547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe418614-cf76-452f-9c25-ccb8687ce10d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:49.561199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:49.561795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:49.562067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:49.562335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:49.572586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:49.574065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f568ff-f3d0-4dca-8e7e-d4c1b0b9affe service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:49.583432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 771/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:51.834342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b419ec-1b68-4682-8b09-b51c9df2800e None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:51.835494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b419ec-1b68-4682-8b09-b51c9df2800e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:51.835494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b419ec-1b68-4682-8b09-b51c9df2800e None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:51.837178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:51.842756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d361-fd2d-4153-a9d4-cadae0ddaea8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:51.843166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d361-fd2d-4153-a9d4-cadae0ddaea8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:51.843352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d361-fd2d-4153-a9d4-cadae0ddaea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:51.865314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2e73d361-fd2d-4153-a9d4-cadae0ddaea8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:51.867588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2e73d361-fd2d-4153-a9d4-cadae0ddaea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:51.876061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:52.169681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b419ec-1b68-4682-8b09-b51c9df2800e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:52.181038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b419ec-1b68-4682-8b09-b51c9df2800e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:52.184530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:52.185149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:52.185432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:52.185706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:52.196490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:52.196985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20714-d4af-430f-ba59-916d50866ee7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:52.208834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 761/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:56.051815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:56.052432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:56.052432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:56.053779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:56.059435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8572-be62-4ee5-baeb-52cd7e0cab92 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:56.059884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8572-be62-4ee5-baeb-52cd7e0cab92 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:56.059982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae8572-be62-4ee5-baeb-52cd7e0cab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:56.079564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7cae8572-be62-4ee5-baeb-52cd7e0cab92 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:56.080870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7cae8572-be62-4ee5-baeb-52cd7e0cab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:56.089006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:56.411195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:56.413807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:56.478115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:56.492526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f665-71bb-4746-b956-7e0c4c2561cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:56.496129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:56.496750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:56.497029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:56.497299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:56.509578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:56.511082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2583fe-4cc3-4219-92e3-3a0be6b5b7fb service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:56.520780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 774/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:58.742114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:58.742676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:58.742676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:58.744040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:23:58.749448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86b64-de0d-45b3-9a29-6ab357c41ea7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:58.749847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86b64-de0d-45b3-9a29-6ab357c41ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:58.749989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86b64-de0d-45b3-9a29-6ab357c41ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:58.770435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5db86b64-de0d-45b3-9a29-6ab357c41ea7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:58.771627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5db86b64-de0d-45b3-9a29-6ab357c41ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:58.779729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:59.093560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:59.095239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:59.102878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:59.109532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5409-b32c-4714-be34-776a8a8fdfdd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:59.113561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:59.114168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:59.114443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:59.114710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:59.123772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:59.125287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119973c-6226-4b91-ab2c-1156bf58aeb0 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:59.135800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 764/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:24:08.765530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=11 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:09.130533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:34.702875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.704211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.704743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.733195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:34.734859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:34.745291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 776/1540] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:34.755945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66af2-ced4-4b46-acfe-1b1a631f942b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.756558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66af2-ced4-4b46-acfe-1b1a631f942b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.756558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66af2-ced4-4b46-acfe-1b1a631f942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.807405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-5aa66af2-ced4-4b46-acfe-1b1a631f942b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:34.808662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5aa66af2-ced4-4b46-acfe-1b1a631f942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:34.825288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 765/1541] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:34.830231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:34.850212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafde82-70d6-4c09-a10c-ab03a6ce17cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:34.857506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:34.858463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.859240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.859732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.860660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:34.860787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.861033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.861309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.861732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:34.863526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21070434-179f-476c-bc94-b61433c267eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:34.878582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 777/1542] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:34.881134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730bb3-f58f-4b7d-8b69-a5e674a9dbc0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.881656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730bb3-f58f-4b7d-8b69-a5e674a9dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.882151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730bb3-f58f-4b7d-8b69-a5e674a9dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.900610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:34.902510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:34.912894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-02730bb3-f58f-4b7d-8b69-a5e674a9dbc0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:34.915373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-02730bb3-f58f-4b7d-8b69-a5e674a9dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:34.922188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 766/1543] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:25:34.922188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:34.933199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 778/1544] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:34.936276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420f82-c813-4f3c-bd91-72d1c5580958 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.937042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420f82-c813-4f3c-bd91-72d1c5580958 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.937732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420f82-c813-4f3c-bd91-72d1c5580958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.938126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68214e-5fa5-4c6e-92ce-7a565da39844 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:34.954749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:34.955610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.955877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.956147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:34.956964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:34.958900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56ec85-bf9a-4418-a213-908abc2c22a5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:34.977684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-50420f82-c813-4f3c-bd91-72d1c5580958 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:34.977684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50420f82-c813-4f3c-bd91-72d1c5580958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:34.989341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 779/1545] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:34.990885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d1660-b086-4870-b5e3-830a7e1fbec8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:34.991636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d1660-b086-4870-b5e3-830a7e1fbec8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:34.991636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d1660-b086-4870-b5e3-830a7e1fbec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.010719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 767/1546] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.011849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aca71-0052-46d7-a610-5f3b9e1c737d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.012136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aca71-0052-46d7-a610-5f3b9e1c737d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.012408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aca71-0052-46d7-a610-5f3b9e1c737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.012638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-335d1660-b086-4870-b5e3-830a7e1fbec8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.013861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-335d1660-b086-4870-b5e3-830a7e1fbec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.032723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bf4aca71-0052-46d7-a610-5f3b9e1c737d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.033923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bf4aca71-0052-46d7-a610-5f3b9e1c737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.074528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 780/1547] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.075884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8294-e2ee-4b79-8ea8-a989a287cbe8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.076170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8294-e2ee-4b79-8ea8-a989a287cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.076440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8294-e2ee-4b79-8ea8-a989a287cbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.095823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0f6e8294-e2ee-4b79-8ea8-a989a287cbe8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.097055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f6e8294-e2ee-4b79-8ea8-a989a287cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.097948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 768/1548] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.099184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5f38-ecb8-40b6-ae5f-e69073dc83a6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.099468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5f38-ecb8-40b6-ae5f-e69073dc83a6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.099737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a5f38-ecb8-40b6-ae5f-e69073dc83a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.105616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 781/1549] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.106724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc7c3c-8cf3-4d65-b75c-366d44f1a69a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.107005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc7c3c-8cf3-4d65-b75c-366d44f1a69a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.107273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc7c3c-8cf3-4d65-b75c-366d44f1a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.121743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-265a5f38-ecb8-40b6-ae5f-e69073dc83a6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.122989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-265a5f38-ecb8-40b6-ae5f-e69073dc83a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.126788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1cc7c3c-8cf3-4d65-b75c-366d44f1a69a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.127930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1cc7c3c-8cf3-4d65-b75c-366d44f1a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.131269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 769/1550] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.132232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081885-86ac-4d53-a325-9e75c48b9c1f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.132514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081885-86ac-4d53-a325-9e75c48b9c1f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.133522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081885-86ac-4d53-a325-9e75c48b9c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.137055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 782/1551] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.138249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.138666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.138794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.160338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e3081885-86ac-4d53-a325-9e75c48b9c1f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.160556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.161592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.161716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e3081885-86ac-4d53-a325-9e75c48b9c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.169718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 783/1552] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.169879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 770/1553] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.170590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.171493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.171775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.172043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.183815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241dac6-a1c8-4d80-8c66-d945867030d4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.188818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.189227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.189505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.189774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.190391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.192308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.195900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.197219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.205195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 771/1554] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.207648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.217631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 784/1555] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.218027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157f01-b753-4080-a6f8-e64c28fa6c75 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.221507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.222757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.223348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.223621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.223884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.224521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.224847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.225859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:35.225859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:25:35.225859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:25:35.226894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0525-f774-41ba-b736-c72932a5e0be admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.232026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e89e-2fc6-428a-b330-ff9b14812508 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.237804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.238392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.238663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.238927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.239322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 772/1556] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.239816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.240113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.241076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.241443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.241728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a38d5-9600-49b4-82ff-5e872b823b59 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.241848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.269662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 785/1557] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.269662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c281f0d-f626-4abe-828b-542e86f0b45e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.269662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c281f0d-f626-4abe-828b-542e86f0b45e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.269662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c281f0d-f626-4abe-828b-542e86f0b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.270169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.270169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.275005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 773/1558] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.275812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.287934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe454bff-2e46-4f3f-a2d2-f3031ad325b4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.291612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5c281f0d-f626-4abe-828b-542e86f0b45e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.292841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5c281f0d-f626-4abe-828b-542e86f0b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.294568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.295183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.295463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.295737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.296384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.296722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.298330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.300821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 786/1559] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.301807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.302081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.302347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.317857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 774/1560] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.317857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.327468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:35.327856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41ecc5-7ced-4798-85a9-70f77598f460 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.328789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:35.332562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.333184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.333589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.333990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.334645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.334944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.337290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.337711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 787/1561] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:35.338560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.357231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 775/1562] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.357430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77b1df-cb61-4ff0-892a-dce7a8d5d762 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.357535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.357626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.357626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.357806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.358122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.358729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.360366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.361323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d580b0-d22e-4145-9a7b-b66ef2b6dcad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.366218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.366807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.367125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.367798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.368019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.369920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.374342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 788/1563] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:35.374342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.382222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1963c-db92-437a-864f-c3e92c45cd87 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.387904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.388846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.389388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.389844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.390889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.392346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:35.392346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:25:35.392346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:25:35.393727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.401663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 776/1564] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.402494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.426014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 789/1565] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.426014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.437603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:35.461627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:35.471375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868408-b83c-4b9b-87e4-50ee040a475f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.492499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603181-1a1a-43ce-909d-3a709e6aba98 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.497362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.497964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.498244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.498517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.499160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.499608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.501705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.514262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 790/1566] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.515126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.528070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.528708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.528989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.529258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.529898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.530197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.531478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22de-4659-4d76-a82f-163493368a85 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.531784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.536196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.536885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.537167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.537438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.538061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.540320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.543256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 777/1567] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.543838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.554985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ef1a2-9fef-472e-918c-64e28f265c4a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.560417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.561058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.561339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.561968 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.562264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:35.562665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.564248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.573274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 791/1568] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.573274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.577719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 778/1569] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:35.578418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.588945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448394-8663-41d6-98bb-bd6d7fe501c6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.645774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0423f-dcba-4483-ace5-5c438e28c1db admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.650449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.651230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.651573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.651683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.651969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.652232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.652513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.652824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.652921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.653548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.654615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.655590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.665212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 779/1570] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:35.666333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.675815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9993889-1b79-45a1-bc2e-fb161bfc59ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.681207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.681799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.682079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.682353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.682974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.683980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:35.683980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:25:35.683980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:25:35.685245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.691575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 792/1571] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.692443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.709707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 780/1572] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.710524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.722299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124f03-73af-44f8-a898-5f47a2bc3c12 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.755191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:35.759924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef864ac-bce7-41e4-939e-f214b0ff1a08 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.765024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.765710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.766068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.766408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.767113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.769146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.782876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.783510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.783774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.784070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.784727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.786609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.792005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 793/1573] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.792837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.802350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2505-9533-496e-9631-3371a6b1317a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.808431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.809753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.810030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.810301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.810910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.812834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.822815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 781/1574] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.822815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.829252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:35.845507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 794/1575] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.845507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.888156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d59b-45ad-4963-a3af-b6d152d543b4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.904475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743d0cb-13ff-45c8-aca3-0c0cd0b999ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:35.909157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.909842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.910117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.910383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.911033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.912943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.942976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 795/1576] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.942976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.948467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:35.949162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:35.949457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:35.949781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:35.950334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:35.952255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:35.979255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 782/1577] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:35.979255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:35.988806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325a7d7-ba5e-451d-bd40-04495d267791 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.008839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f0f3-2479-48cd-9ed3-439bee0359f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.013481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.014140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.014417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.014691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] PATH_INFO: `/v3/projects/88d9cebff3ff4028bf6de760dafe35b1/users/0c2b75a0f6a2403fa7d67ca3b8ea6285/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.029435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d9cebff3ff4028bf6de760dafe35b1, user_id=0c2b75a0f6a2403fa7d67ca3b8ea6285, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.030466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:36.030466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:25:36.030466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:25:36.032378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.042419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.046031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 796/1578] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:35 2022] PUT /identity/v3/projects/88d9cebff3ff4028bf6de760dafe35b1/users/0c2b75a0f6a2403fa7d67ca3b8ea6285/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.047366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.050689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.051315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.051814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.052287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.053112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.056215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.078249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 783/1579] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:35 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:36.079279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.088866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d890285-cfd2-480c-ba18-5e3151fcd20b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.113217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f605f3-e8b7-439e-be96-dc8cc2448e2f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.118855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.119451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.119724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.120014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.120699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.122309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.127934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.134001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 797/1580] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.135146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.145880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c14cb-faab-44b6-9cca-99970a292bce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.150494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.151069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.151344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.151456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.151617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.152044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.152255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.152378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.152615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.153254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.154204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.154893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.165476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 784/1581] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.166376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.176490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cc9-a2ed-4501-b67f-6fd91a72d6bd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.178492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 798/1582] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:36.179312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.184536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.185158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.185441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.185714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.186333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.188259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.191674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b05a-8577-4e11-a970-a080aca2dd3f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.201348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.202245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.202694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.202967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.203686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.205845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5afae0-4539-4e29-ac4f-8c2f4ce6bd60 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.214162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 785/1583] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:36.214982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.225301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a319ae-655b-44f6-b7b4-277bece56d8e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.231202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.231837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.232117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.232300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 799/1584] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:36.232531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.233041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.234637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.236486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.236809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.237109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.246987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 786/1585] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.247805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.257311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bdc10-c7f6-4e14-ab3f-cc234d738b29 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.259373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:36.260563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:36.262777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.263364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.263641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.263919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.264543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.266136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.268305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 800/1586] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:36.269182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.278983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d395f-e1d7-461e-8688-197a9afb6b3b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.284394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 787/1587] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.284394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.286299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.286888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.287161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.287422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.288051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.290299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.292913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e61f9-747c-40b7-8fb8-a1bc41901963 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.297522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.298104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.298385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.298655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.299314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.303467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 801/1588] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.303609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.303727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.310975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0ffb-f430-40f0-bbad-d96811e8e71e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.312306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 788/1589] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.315498 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.316072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.316341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.316442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.316637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.317263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.318823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.326208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff1ea-1c07-4fd0-a5c6-469d75b0a6bd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.332404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 802/1590] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.332404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.333285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.333896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.334175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.334442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.335069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.336869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.341974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a454-7e20-45b3-bc0a-9217e99892a6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.347669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.347819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 789/1591] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.348095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.348367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.348481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.348666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.349289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.350891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.360262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24d3c-e5bc-43a0-b7c4-e2ec1edb73df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.362276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 803/1592] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.365842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.365982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.366508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.366792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.367103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.367824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.369400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.380622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 790/1593] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.381071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.391158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c8f2-d287-49ff-93a0-2adcc404d322 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.395980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.396627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.396913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.397183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.398349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.400520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.413794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 791/1594] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.413794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.420599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a1da0-a8a1-4682-9cf9-6ea3bf7ea07b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.425146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.425779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.426058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.426328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] PATH_INFO: `/v3/projects/30243888b7344787bf314f8b1ae185c3/users/bdb73bfe2c0141f6a18c50555dbfb662/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.427726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282f03e-8ef6-45da-aea2-02b4e0cf9a8e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.432294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.432923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.433304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.433607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.441267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=30243888b7344787bf314f8b1ae185c3, user_id=bdb73bfe2c0141f6a18c50555dbfb662, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.442960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.443899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.444362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.455603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 804/1595] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:36.456466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.458772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 792/1596] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/30243888b7344787bf314f8b1ae185c3/users/bdb73bfe2c0141f6a18c50555dbfb662/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.459430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.467277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61c1c-5393-4ec7-b112-0e59a802aa12 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.500941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.527061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18040596-1a76-45d8-bd05-ce4c887584ce admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.528831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.529569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.529913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.530186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] PATH_INFO: `/v3/projects/1074ec6233614cb89f29dfbea8a2f03c/users/8d823c4adeaf4ddcbc039d58b4e3ec05/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.532834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.534280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.534280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.534280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.534604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.536238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.547539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1074ec6233614cb89f29dfbea8a2f03c, user_id=8d823c4adeaf4ddcbc039d58b4e3ec05, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.548746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 793/1597] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.550133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.550395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.564881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c490-b05a-4eb9-b8f4-b38b62efaf28 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.572685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 805/1598] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/1074ec6233614cb89f29dfbea8a2f03c/users/8d823c4adeaf4ddcbc039d58b4e3ec05/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.574402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.589417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.630682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.631354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.632243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.632243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.632748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.634430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.646530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 794/1599] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.647376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.654321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db9035-b1cf-47eb-92da-a63e5f6df873 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.660357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.661097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.661227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0bad-a996-4a98-87d8-b9f5b512ea20 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.661375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.661766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.662640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.665563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.667217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.667766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.668050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.669246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] PATH_INFO: `/v3/projects/c18f75dffcd4435f88dbccbba8bd994b/users/0ae27430186b42b88d0ad7ba442fc7e6/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.681028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 806/1600] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:36.681944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.687060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18f75dffcd4435f88dbccbba8bd994b, user_id=0ae27430186b42b88d0ad7ba442fc7e6, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.689878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c566cc-4f8f-46eb-8714-d0740cf36196 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.692504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74eb18-dfbe-48cc-837a-87bc039c407b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.699369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.700378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.700728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.701188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] PATH_INFO: `/v3/projects/062f13f72ab84a578b689308ff835bb8/users/ceed6d28cfe045318f5aabc9fefa9fa3/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.707535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 795/1601] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/c18f75dffcd4435f88dbccbba8bd994b/users/0ae27430186b42b88d0ad7ba442fc7e6/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.709014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255f82-5c8a-4d5e-a52f-4c1f3780f570 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.709500 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255f82-5c8a-4d5e-a52f-4c1f3780f570 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.709869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44255f82-5c8a-4d5e-a52f-4c1f3780f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.720972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062f13f72ab84a578b689308ff835bb8, user_id=ceed6d28cfe045318f5aabc9fefa9fa3, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.723686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.730882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-44255f82-5c8a-4d5e-a52f-4c1f3780f570 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:36.732518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-44255f82-5c8a-4d5e-a52f-4c1f3780f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:36.743178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 807/1602] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/062f13f72ab84a578b689308ff835bb8/users/ceed6d28cfe045318f5aabc9fefa9fa3/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.744207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.809819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 796/1603] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:36.811355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.811718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.812088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.844538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1d39-0d2b-48ed-9d89-b3b4494eab32 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.845328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] MFA Rules not processed for user `8d823c4adeaf4ddcbc039d58b4e3ec05`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:36.847745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:36.851522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.852476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.853024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.853392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] PATH_INFO: `/v3/projects/72cae09d5e8e4f2a88591477e930557d/users/e729d44717854f2eab82f3dcdb72e516/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:36.871399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cae09d5e8e4f2a88591477e930557d, user_id=e729d44717854f2eab82f3dcdb72e516, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:36.874346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:36.894306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.896633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 808/1604] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/72cae09d5e8e4f2a88591477e930557d/users/e729d44717854f2eab82f3dcdb72e516/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:36.897759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.943717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 797/1605] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:36.951106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:36.969210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30770fe-1ac9-4a87-9fc9-be23c8c540ab None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.984912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd869-632f-43ae-b67a-d6379b765760 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:36.992145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:36.992945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:36.993257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:36.994160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] PATH_INFO: `/v3/projects/0fe999db876c4b389984a883de35321f/users/c63601cecb6b48ce91e26d191d97c1e9/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.009133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:37.016484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe999db876c4b389984a883de35321f, user_id=c63601cecb6b48ce91e26d191d97c1e9, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.019872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f63ad1-e934-43ec-a1b5-30404de62130 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.035733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 809/1606] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/0fe999db876c4b389984a883de35321f/users/c63601cecb6b48ce91e26d191d97c1e9/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:37.037023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.037325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.037585 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.048039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.049337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.049689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.049995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] PATH_INFO: `/v3/projects/296bd88ce3e540a1a3e06672ff1ff58f/users/412b04765ad44f598dd7b56ba0576f0d/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.063651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.065018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.070587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=296bd88ce3e540a1a3e06672ff1ff58f, user_id=412b04765ad44f598dd7b56ba0576f0d, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.074216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc85118-2608-49b8-aa68-1fcbd7b2b2cf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.096863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 798/1607] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:36 2022] PUT /identity/v3/projects/296bd88ce3e540a1a3e06672ff1ff58f/users/412b04765ad44f598dd7b56ba0576f0d/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:37.099358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c973-67cf-410c-91e8-16e92155e9c1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.099358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c973-67cf-410c-91e8-16e92155e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.099358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c973-67cf-410c-91e8-16e92155e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.130823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-72d3c973-67cf-410c-91e8-16e92155e9c1 None None] MFA Rules not processed for user `ceed6d28cfe045318f5aabc9fefa9fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.132446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-72d3c973-67cf-410c-91e8-16e92155e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.139805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 810/1608] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.140925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:37.142377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.231401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 799/1609] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.233029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c94ad-f619-4be3-ade4-ab7115107bb2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.233283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0ee93-cfb5-4ed4-85c6-2d136498bda4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:37.233447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c94ad-f619-4be3-ade4-ab7115107bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.233795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c94ad-f619-4be3-ade4-ab7115107bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.272843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-660c94ad-f619-4be3-ade4-ab7115107bb2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.275318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-660c94ad-f619-4be3-ade4-ab7115107bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.318919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.319697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.319984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.320377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.328917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:37.350913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 800/1610] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.353411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00c0c-0cdf-4ae3-9032-7e81d6cdeba1 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.353836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00c0c-0cdf-4ae3-9032-7e81d6cdeba1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.354267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00c0c-0cdf-4ae3-9032-7e81d6cdeba1 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.360877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 801/1611] 10.222.0.71 () {54 vars in 965 bytes} [Mon Sep 19 11:25:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:37.363428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.363713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.364767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.398007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:37.402050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.402764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] MFA Rules not processed for user `c63601cecb6b48ce91e26d191d97c1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.403900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522231d0-c58a-455d-aa39-2b01dea662ec service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.404807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.435988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 811/1612] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:37.437592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.439813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.444831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.519105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] MFA Rules not processed for user `412b04765ad44f598dd7b56ba0576f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.520411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.521531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 802/1613] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.522740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:37.536212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed1e8-1387-4a45-8764-c7c49789cfbf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:37.540872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.542315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.542604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.543054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.558024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.559545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6da18e-ca65-41f3-90bc-72af51c7d5e2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.574857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 803/1614] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:37.576763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f3fb-63b4-4842-ba32-68e4e902be17 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.577301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f3fb-63b4-4842-ba32-68e4e902be17 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.577544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067f3fb-63b4-4842-ba32-68e4e902be17 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.579711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 804/1615] 10.222.0.71 () {54 vars in 965 bytes} [Mon Sep 19 11:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:37.585749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067f3fb-63b4-4842-ba32-68e4e902be17 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:37.604953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067f3fb-63b4-4842-ba32-68e4e902be17 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:37.611182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.611849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.613055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.613354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.629026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.630938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9249e-ef55-49e9-a63d-4f5147b34a66 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.646359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 805/1616] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:37.647753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.648038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.648360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.651150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 812/1617] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.652006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:37.675859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd98ad3-4913-466f-94f2-c74d115886c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:37.685718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.687066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.688024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.688948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.689741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.694644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79ed93-64d4-43f2-a4d2-7f6bdf4eda3e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.707009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.708681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.761848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 813/1618] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:37.770228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.770544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.770849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.814094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 806/1619] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.815855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:37.827592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:37.829117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:37.832822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72f787-b92a-4f5e-aa94-e6cd1643292a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:37.884366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:37.966490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:37.967311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:37.967721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:37.968129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:37.968918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:37.972386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:37.988058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 814/1620] 10.222.0.71 () {58 vars in 1062 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:37.989786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.003078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec32c83-12aa-4e3f-b6a5-06e0dcb03654 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.018713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 807/1621] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:38.024819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.026134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.027469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.028026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.028651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.029810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.034228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.087399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 815/1622] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:37 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:38.088263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.123714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7ffba-7c98-4086-9a7c-ef1b47f33479 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.137105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.137725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.138000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.138267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.140547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76940c6-2784-469b-8a8a-e4dbb6a60aba admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.153708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612682a4-2956-4598-96df-470beed86d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.159306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612682a4-2956-4598-96df-470beed86d14 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.160493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612682a4-2956-4598-96df-470beed86d14 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.160908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612682a4-2956-4598-96df-470beed86d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.212591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:38.267042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.267818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612682a4-2956-4598-96df-470beed86d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.269736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.270051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612682a4-2956-4598-96df-470beed86d14 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.282126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 816/1623] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:38.283129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.292736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 808/1624] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:38.306968 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612682a4-2956-4598-96df-470beed86d14 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.461817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee89e2d-54bd-4883-91fd-2e41924197c4 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.470543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:38.471561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.473473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.474568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.474868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.475487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.483790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.496828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612682a4-2956-4598-96df-470beed86d14 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.509657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.510384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.510669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.510944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.513126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.514580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.530609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 817/1625] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:38 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:38.534697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.546644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 809/1626] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:38.659251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.660082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2239e-d4b5-4f16-a66f-6af58434e37b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.660082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.660637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e51c6-0df0-43aa-b857-a45d43a52751 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.660897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.660897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.660897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.660897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.660897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.661526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.661526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.661526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.661526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] PATH_INFO: `/v3/projects/4459065573d34fa6aefe5b95984058a4/users/fb1aab9fe9174bd48df0c2d7c63c53d4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.661997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 818/1627] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:38.661997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.686548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4459065573d34fa6aefe5b95984058a4, user_id=fb1aab9fe9174bd48df0c2d7c63c53d4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.701182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9f34a-fa41-4feb-8542-adc58d71e8a7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.701947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.730452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.733546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.737502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.738063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] PATH_INFO: `/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c/users/6faec9c3585045779e7ff731b4daa4e8/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.752726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 810/1628] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:38 2022] PUT /identity/v3/projects/4459065573d34fa6aefe5b95984058a4/users/fb1aab9fe9174bd48df0c2d7c63c53d4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:38.753872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.792598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d17d87dc3447ea94d6d2dd141b6e3c, user_id=6faec9c3585045779e7ff731b4daa4e8, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.804247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e126-9f2d-4875-9322-17ab32288828 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:38.837781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 819/1629] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:38 2022] PUT /identity/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c/users/6faec9c3585045779e7ff731b4daa4e8/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:38.841062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69483b9-3e6e-479f-b20a-ddd1125e3b44 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.841488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69483b9-3e6e-479f-b20a-ddd1125e3b44 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.843182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69483b9-3e6e-479f-b20a-ddd1125e3b44 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.864103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 820/1630] 10.222.0.71 () {54 vars in 912 bytes} [Mon Sep 19 11:25:38 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:38.871023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bf130-dc9e-4e9e-a1dc-6e0b1b49f9af None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.871565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bf130-dc9e-4e9e-a1dc-6e0b1b49f9af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.871895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bf130-dc9e-4e9e-a1dc-6e0b1b49f9af None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.874461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 821/1631] 10.222.0.71 () {54 vars in 912 bytes} [Mon Sep 19 11:25:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:38.875444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bf130-dc9e-4e9e-a1dc-6e0b1b49f9af None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:38.907053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c786-ec17-47eb-9c62-652fab5da061 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:38.992360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:38.993081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:38.994006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:38.994338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:38.995157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:38.997055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298e47b-0af5-4800-b50d-3c41dff6ce55 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.032199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 811/1632] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:39.033725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.034021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.034296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.045762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bf130-dc9e-4e9e-a1dc-6e0b1b49f9af None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:39.051263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:39.052120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.052405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.052727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.053469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:39.055503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7412d-e911-4480-99c7-5caafc103295 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.069072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 822/1633] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:39.071238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.071708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.072124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.072540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:39.074317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:39.100296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:39.101769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:39.144880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:39.214076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:39.244326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 823/1634] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:39.245483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:39.262980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 812/1635] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:39.265413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:39.266042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4dda-fb4f-4b62-9c0e-9989dff0e525 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:39.288430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:39.290144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.290490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.290840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] PATH_INFO: `/v3/projects/4459065573d34fa6aefe5b95984058a4/users/fb1aab9fe9174bd48df0c2d7c63c53d4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.293364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284148a-51e0-4415-b137-cdb6b5fbc877 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:39.297799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4459065573d34fa6aefe5b95984058a4, user_id=fb1aab9fe9174bd48df0c2d7c63c53d4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:39.300813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.315435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:39.316848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.317380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.318117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] PATH_INFO: `/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c/users/6faec9c3585045779e7ff731b4daa4e8/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.323467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d17d87dc3447ea94d6d2dd141b6e3c, user_id=6faec9c3585045779e7ff731b4daa4e8, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:39.327146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 824/1636] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:39 2022] PUT /identity/v3/projects/4459065573d34fa6aefe5b95984058a4/users/fb1aab9fe9174bd48df0c2d7c63c53d4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:39.337634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:39.338661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.380419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 813/1637] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:39 2022] PUT /identity/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c/users/6faec9c3585045779e7ff731b4daa4e8/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:39.380419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:39.477536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866482a-2789-4666-a4b2-24a26e62064a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:39.499391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038d23c-caf3-4c94-84ee-9b8ed433ee99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:39.503869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:39.504823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.505206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.505551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.623600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:39.624644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.625097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.625533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.629102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:39.633448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd5f0d-2bcb-4911-91e9-84a8a9559819 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.641714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:39.644529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cd5cd-c65a-4f53-828a-4fcdb6248968 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:39.668746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 825/1638] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:39.670186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 814/1639] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:39.671814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2823f-e3a1-4c60-824e-27fe4dc5cd59 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.672425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2823f-e3a1-4c60-824e-27fe4dc5cd59 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.672871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2823f-e3a1-4c60-824e-27fe4dc5cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.673604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:39.674137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:39.674796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:39.712572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4af2823f-e3a1-4c60-824e-27fe4dc5cd59 None None] MFA Rules not processed for user `6faec9c3585045779e7ff731b4daa4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:39.713909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4af2823f-e3a1-4c60-824e-27fe4dc5cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:39.724062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] MFA Rules not processed for user `fb1aab9fe9174bd48df0c2d7c63c53d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:39.726092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:39.840769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:39.874867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 815/1640] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:39.885436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 826/1641] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:40.467517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:40.467517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:40.467517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:40.497392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:40.511567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] MFA Rules not processed for user `e729d44717854f2eab82f3dcdb72e516`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:40.512967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:40.665873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:40.679414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb873de-c4ff-48d6-b372-e4d869a9dcaf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:40.689533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:40.690481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:40.691159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:40.691621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:40.720075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:40.728954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 816/1642] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:40.730135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:40.740693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:40.780399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 827/1643] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:25:40.829024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:40.842392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9807-b077-4959-821f-af822d205bbf service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:40.848160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:40.849454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:40.850153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:40.850634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:40.866225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:40.869351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:40.890503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 828/1644] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:40.904877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811369cf-69d0-4965-8370-ce332d1b77f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:40.909629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:40.910248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:40.910531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:40.910803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:40.911437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:40.913387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:40.975158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 817/1645] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:40 2022] POST /identity/v3/projects => generated 403 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:40.979761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:40.999929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a76c5-f769-4c6f-8667-9a9ea03b9047 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.121046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.124608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.124608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.124608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.125954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.130481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.185346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 829/1646] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:40 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:41.193475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:41.236394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a3bd6-3691-460a-9c41-9f782fb1b90b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.258214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.260343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.261544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.262811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.266803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.274842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.308792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 818/1647] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:41.309806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:41.365401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b87cec-8393-4703-aeed-7906e4709274 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.365401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.365401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.365401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.386666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] PATH_INFO: `/v3/projects/0b28141d01cd42ef92f601b6098c5f42/users/2f9d93ec683c4c59bfb49b953f13ad62/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.387221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:41.416880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28141d01cd42ef92f601b6098c5f42, user_id=2f9d93ec683c4c59bfb49b953f13ad62, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.421125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.456654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 830/1648] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:41 2022] PUT /identity/v3/projects/0b28141d01cd42ef92f601b6098c5f42/users/2f9d93ec683c4c59bfb49b953f13ad62/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:41.461338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:41.514745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5488-91d2-4a08-b073-959023ac08b9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.581967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e0be-80cc-4e76-b3f6-1fc2bc9f1f67 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.584710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:41.590198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.592301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.592777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.593181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.594083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.596658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.619222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 831/1649] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:41.623621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:41.631236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.631856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.632129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.632394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.639706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a274b7-281c-4eb3-adff-9bab0a7c6721 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:41.649368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:41.650867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:41.651500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:41.651852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] PATH_INFO: `/v3/projects/0b28141d01cd42ef92f601b6098c5f42/users/2f9d93ec683c4c59bfb49b953f13ad62/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:41.656164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28141d01cd42ef92f601b6098c5f42, user_id=2f9d93ec683c4c59bfb49b953f13ad62, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.661771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.681573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 832/1650] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:41 2022] PUT /identity/v3/projects/0b28141d01cd42ef92f601b6098c5f42/users/2f9d93ec683c4c59bfb49b953f13ad62/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:41.825718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:41.827186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10950455-b686-47db-b519-d0742bbfa33b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:41.855062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 819/1651] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:42.884708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:42.905505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:43.029471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67940c9-b880-4dfd-baf2-6ccb74d88ea2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:43.036835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:43.037702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:43.038019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:43.040462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] PATH_INFO: `/v3/users/c63601cecb6b48ce91e26d191d97c1e9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:43.041818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63601cecb6b48ce91e26d191d97c1e9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:43.043518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:43.043518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 19 11:25:43.043518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: Sep 19 11:25:43.045328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:43.226566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63601cecb6b48ce91e26d191d97c1e9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:43.228665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63601cecb6b48ce91e26d191d97c1e9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:43.254057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63601cecb6b48ce91e26d191d97c1e9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:43.318431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63601cecb6b48ce91e26d191d97c1e9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:43.318431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de97b58f-0ece-4fb4-98fe-e5e80a666ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63601cecb6b48ce91e26d191d97c1e9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:43.320331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:43.320874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:43.320874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:43.350987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 833/1652] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:42 2022] DELETE /identity/v3/users/c63601cecb6b48ce91e26d191d97c1e9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:43.354481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:43.355102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:43.355582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:43.390493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] MFA Rules not processed for user `2f9d93ec683c4c59bfb49b953f13ad62`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:43.392651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:43.401506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:43.402740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:43.549827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 820/1653] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:43.560964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 834/1654] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:43.620033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:43.628958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:43.804851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210ed9-56e6-4089-89b0-8bd30b292e6d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:43.821671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:43.822511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:43.822977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:43.823344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:43.859824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:43.868448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12a18-c2e1-49e3-95a9-c37efca7d5d3 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:43.893350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 821/1655] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:44.169244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:44.173316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:44.198875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e8629-6884-4c6a-b526-9160d0fbe6ba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:44.220123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:44.220923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:44.221206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:44.221484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] PATH_INFO: `/v3/users/ceed6d28cfe045318f5aabc9fefa9fa3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:44.224199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceed6d28cfe045318f5aabc9fefa9fa3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:44.228282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:44.361812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:44.406102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceed6d28cfe045318f5aabc9fefa9fa3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:44.407604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceed6d28cfe045318f5aabc9fefa9fa3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:44.440257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceed6d28cfe045318f5aabc9fefa9fa3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:44.472727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceed6d28cfe045318f5aabc9fefa9fa3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:44.473869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceed6d28cfe045318f5aabc9fefa9fa3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:44.504697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 835/1656] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:44 2022] DELETE /identity/v3/users/ceed6d28cfe045318f5aabc9fefa9fa3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:44.510523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:44.510999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:44.512000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:44.562724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:44.564626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:44.589382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:44.748707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 822/1657] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:44.787669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:44.790701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:44.900001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:44.901875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:44.909321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaad110-fc4f-4989-90f7-9f44bf7c5c97 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:44.925122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:44.927250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:44.927665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:44.928070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:44.936196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc102f0-be28-4be8-bd38-b8154da90e07 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:44.939823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:44.941521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:44.946831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:44.947575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:44.948531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:44.948883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] PATH_INFO: `/v3/projects/0fe999db876c4b389984a883de35321f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:44.950599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe999db876c4b389984a883de35321f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:44.952409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: WARNING py.warnings [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:25:44.952409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: warnings.warn(msg) Sep 19 11:25:44.952409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: Sep 19 11:25:44.954303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:44.956351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 836/1658] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:45.080601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe999db876c4b389984a883de35321f', 'request_id': 'req-9cfda256-21ed-4a92-8a28-f45248cbc597'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.095625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe999db876c4b389984a883de35321f', 'request_id': 'req-9cfda256-21ed-4a92-8a28-f45248cbc597'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.117664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe999db876c4b389984a883de35321f', 'request_id': 'req-9cfda256-21ed-4a92-8a28-f45248cbc597'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.143095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] The token cache is being invalidate because project 0fe999db876c4b389984a883de35321f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:45.143842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.145928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.149359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 823/1659] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:44 2022] DELETE /identity/v3/projects/0fe999db876c4b389984a883de35321f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:25:45.153213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:45.172430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429e08-0eb5-45d8-9e31-53c3b824a830 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:45.307907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:45.309862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:45.310163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:45.310953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] PATH_INFO: `/v3/users/fb1aab9fe9174bd48df0c2d7c63c53d4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:45.312793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1aab9fe9174bd48df0c2d7c63c53d4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:45.315086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:45.343673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:45.346096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:45.379239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfda256-21ed-4a92-8a28-f45248cbc597 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:45.406784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:45.407478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:45.407757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:45.408025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] PATH_INFO: `/v3/projects/062f13f72ab84a578b689308ff835bb8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:45.409288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] RBAC: Authorizing `identity:delete_project(project_id=062f13f72ab84a578b689308ff835bb8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:45.411290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:45.433506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1aab9fe9174bd48df0c2d7c63c53d4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.434225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1aab9fe9174bd48df0c2d7c63c53d4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.436024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:45.448112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1aab9fe9174bd48df0c2d7c63c53d4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.472021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1aab9fe9174bd48df0c2d7c63c53d4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.473076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1cc61f6f-d095-4b49-87b6-da08a1099d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1aab9fe9174bd48df0c2d7c63c53d4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.529959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 837/1660] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:45 2022] DELETE /identity/v3/users/fb1aab9fe9174bd48df0c2d7c63c53d4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:25:45.537494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062f13f72ab84a578b689308ff835bb8', 'request_id': 'req-4076cd2a-551f-4089-828b-847ccd35adab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.550212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062f13f72ab84a578b689308ff835bb8', 'request_id': 'req-4076cd2a-551f-4089-828b-847ccd35adab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.586989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062f13f72ab84a578b689308ff835bb8', 'request_id': 'req-4076cd2a-551f-4089-828b-847ccd35adab'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.603436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] The token cache is being invalidate because project 062f13f72ab84a578b689308ff835bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:45.603743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.604451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4076cd2a-551f-4089-828b-847ccd35adab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:45.608173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 824/1661] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:45 2022] DELETE /identity/v3/projects/062f13f72ab84a578b689308ff835bb8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:45.613521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:45.613808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:45.614088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:45.665707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:45.667923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:45.826182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 838/1662] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:45.835434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:45.836009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:45.836779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:45.877751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:45.880144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:45.899589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 825/1663] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:45.905317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:45.923479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205373c-5de6-425f-b9cf-7442d7464fba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:45.935384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:45.936170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:45.936552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:45.937621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:45.938587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:45.939939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:45.943927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:45.978951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 839/1664] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:45.983256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:45.999006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c534e-35c2-4189-b92f-33150f9b0965 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.011513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.012245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.012760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.013037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.013941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.016427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.044011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:46.092156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 826/1665] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:45 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:46.096565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.132022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bd90-a0ad-48cf-bf7a-fefffa7ff2f0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.182155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.184368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.313701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.314410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.314648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.314775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880954a-94e7-4dee-aed6-b20e0bbfda57 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.314892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.315559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.317459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.333026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.334819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.334819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.335059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] PATH_INFO: `/v3/projects/4459065573d34fa6aefe5b95984058a4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.337369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4459065573d34fa6aefe5b95984058a4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.346777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.363695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 840/1666] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:46 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:46.370970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.402606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20801a-7469-40c9-bd67-c0a1cef0ebe1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.411612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.414610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.418785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.419229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.420914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.424354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55837bf6-556d-4535-9a5e-fec0f4027acd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.449052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 841/1667] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:25:46.450725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737bcd-62af-45fe-9caa-fe5a70cc5870 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.451147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737bcd-62af-45fe-9caa-fe5a70cc5870 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.453291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737bcd-62af-45fe-9caa-fe5a70cc5870 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.454928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 842/1668] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:46.456232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737bcd-62af-45fe-9caa-fe5a70cc5870 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.465509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4459065573d34fa6aefe5b95984058a4', 'request_id': 'req-2946d04f-37ce-4204-84e5-a532bc5fd477'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:46.478025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4459065573d34fa6aefe5b95984058a4', 'request_id': 'req-2946d04f-37ce-4204-84e5-a532bc5fd477'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:46.486643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4459065573d34fa6aefe5b95984058a4', 'request_id': 'req-2946d04f-37ce-4204-84e5-a532bc5fd477'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:46.519121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] The token cache is being invalidate because project 4459065573d34fa6aefe5b95984058a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:46.520244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:46.521053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2946d04f-37ce-4204-84e5-a532bc5fd477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:46.528341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 827/1669] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:46 2022] DELETE /identity/v3/projects/4459065573d34fa6aefe5b95984058a4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:46.531174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498142-afa0-497a-92a4-8464ff23b031 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.531468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498142-afa0-497a-92a4-8464ff23b031 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.531746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498142-afa0-497a-92a4-8464ff23b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.543186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:46.592525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fc498142-afa0-497a-92a4-8464ff23b031 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:46.594165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fc498142-afa0-497a-92a4-8464ff23b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.622801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 828/1670] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:46.622801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.622801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.622801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.627206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36737bcd-62af-45fe-9caa-fe5a70cc5870 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.636847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.637524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.637808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.638082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.639664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.643076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f3b6-b9ba-4546-a77b-2cf5b519321a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.680888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 843/1671] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:46.682198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.683083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:46.684910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.685896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.687097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.734079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:46.735353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.762293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 844/1672] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:46.763290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.767297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.799315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b064-12d4-4957-ab82-9c44a07150aa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.804923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.805547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.805806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.806078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] PATH_INFO: `/v3/projects/3259c340a539419896a1879c5da1f5a5/users/ad39b4fb1d2543e685370eba2ac9b04f/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.847086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3259c340a539419896a1879c5da1f5a5, user_id=ad39b4fb1d2543e685370eba2ac9b04f, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:46.851806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801ebb7-f081-49a4-9ad6-da52358a5833 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:46.870987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 829/1673] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:46.872350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.875125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 845/1674] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:46 2022] PUT /identity/v3/projects/3259c340a539419896a1879c5da1f5a5/users/ad39b4fb1d2543e685370eba2ac9b04f/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:46.888670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.888964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:46.889217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:46.923996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f1ad-94a9-44c2-b95c-7d5ff1a3c5ac None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.928924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] MFA Rules not processed for user `ad39b4fb1d2543e685370eba2ac9b04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:46.931088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:46.964324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:47.078919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.080888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.081169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.083794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.084963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:47.085311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.093866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.103065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 846/1675] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:47.115332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.119032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.128354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 830/1676] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:47.134315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.136078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.269833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b3b6-2aea-4319-9a5b-d3f3e7efb038 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.286298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.287171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.289619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.289911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.314924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.317575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee2d8-f34a-4174-a8c2-925456dc0307 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.320724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.332936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.333785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.334165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.334541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.344189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 847/1677] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:47.356263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.372543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.374426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.385968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745828-215f-4864-89c9-7ee3e38ebc70 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.413387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 831/1678] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:47.415317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.416678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.419063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.421584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.421750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.422154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.426208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.429038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.483972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278469f-1f5b-4e7c-afe7-2c6572496ebd service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.505990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:47.509586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.510277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.510569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.510845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] PATH_INFO: `/v3/users/8d823c4adeaf4ddcbc039d58b4e3ec05` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.512399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d823c4adeaf4ddcbc039d58b4e3ec05)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.518396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.553002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 848/1679] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:47 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:47.554082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.635717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d823c4adeaf4ddcbc039d58b4e3ec05'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:47.657865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d823c4adeaf4ddcbc039d58b4e3ec05'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:47.692830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d823c4adeaf4ddcbc039d58b4e3ec05'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:47.693599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d823c4adeaf4ddcbc039d58b4e3ec05'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:47.696113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-70000fcc-400a-4e8b-a926-5c26906d173d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d823c4adeaf4ddcbc039d58b4e3ec05'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:47.734870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 832/1680] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:47 2022] DELETE /identity/v3/users/8d823c4adeaf4ddcbc039d58b4e3ec05 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:47.737221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.737620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.737812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.761437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:47.796805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3b7f-2932-411a-b6b5-8e05bf72d803 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.836338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:47.837626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.881282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.882133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.883147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.883563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.884341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.886437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.946277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 849/1681] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:47 2022] POST /identity/v3/users => generated 278 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:47.948045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.953078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.979057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 833/1682] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:25:47.980135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:47.981540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6abd14-8783-45cd-9255-91eedd732e45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:47.985710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.994619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:47.995505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:47.995984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.996602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] PATH_INFO: `/v3/users/ad39b4fb1d2543e685370eba2ac9b04f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.999127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad39b4fb1d2543e685370eba2ac9b04f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.002676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.011379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901c2f-aecc-4b88-8ff5-7f9c68a3db5b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.023068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:48.023990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.024367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.025115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.025331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.028603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.055197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 834/1683] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:48.056180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:48.071512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.120245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad39b4fb1d2543e685370eba2ac9b04f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.122121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad39b4fb1d2543e685370eba2ac9b04f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.144165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad39b4fb1d2543e685370eba2ac9b04f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.152285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011742-edee-49e8-87c6-bd49207fb03f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.156422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:48.157065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.157390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.157665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.160013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.176271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.178803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.182075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad39b4fb1d2543e685370eba2ac9b04f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.183195 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd9730dd-5037-413b-9285-9122ed47b3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad39b4fb1d2543e685370eba2ac9b04f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.198901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 835/1684] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:48.198901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:48.199163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.212484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6954ca-f694-40cb-8ee8-8d97d13c333c service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.213380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 850/1685] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:47 2022] DELETE /identity/v3/users/ad39b4fb1d2543e685370eba2ac9b04f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:48.217031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8a65-d461-4ac4-bb82-c479cdc4e3c7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.217549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8a65-d461-4ac4-bb82-c479cdc4e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.217994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a8a65-d461-4ac4-bb82-c479cdc4e3c7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.219835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 851/1686] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:25:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:48.227284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.227724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.229203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.245310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:48.271562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:48.273780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.326341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:48.326977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.327264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.327560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.328251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.334947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fb404-3faa-46aa-8efd-ed553b424f2b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.362510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 836/1687] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:48.363813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.364100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.364373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.413703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:48.415129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.448412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 852/1688] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:48.449972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:48.453507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.467788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:48.484964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6aa0e-b674-4c9c-898f-34cdef0dccf3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.496193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:48.498368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.500727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.501417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] PATH_INFO: `/v3/users/e729d44717854f2eab82f3dcdb72e516` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.503333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e729d44717854f2eab82f3dcdb72e516)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.512893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.552663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 837/1689] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:48.553772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:48.583889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72112d0-cf7c-4702-931e-2e9b760a4319 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.598258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:48.598808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.599095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.599372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] PATH_INFO: `/v3/projects/4ed0467fe107468085981930bd195a65/users/95de5a229cc04562a96e81fc9a81d96a/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.619474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e729d44717854f2eab82f3dcdb72e516'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.621017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e729d44717854f2eab82f3dcdb72e516'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.627679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed0467fe107468085981930bd195a65, user_id=95de5a229cc04562a96e81fc9a81d96a, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:48.630474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:48.642538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e729d44717854f2eab82f3dcdb72e516'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.656519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 838/1690] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:48 2022] PUT /identity/v3/projects/4ed0467fe107468085981930bd195a65/users/95de5a229cc04562a96e81fc9a81d96a/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:48.674573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:48.674573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.693622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e729d44717854f2eab82f3dcdb72e516'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.696222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1de0b7e3-dbdc-4caf-8e94-698c02d0556d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e729d44717854f2eab82f3dcdb72e516'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:48.734583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 853/1691] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:48 2022] DELETE /identity/v3/users/e729d44717854f2eab82f3dcdb72e516 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:48.735911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:48.736202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:48.737255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:48.833325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] MFA Rules not processed for user `95de5a229cc04562a96e81fc9a81d96a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:48.836373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:48.847934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137a12-54a7-4a57-a15c-dbe9ef0e2557 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:48.998675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 854/1692] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:48.999069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.002442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.003237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.003445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.003553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.003839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.006583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.022666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:49.141654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.146524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.155504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a60135-6492-41a3-ad81-52aad0ecd5a3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.168913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 839/1693] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:49.170003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.170806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.170912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.171104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.171351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.175825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.175979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.203051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f3ba-bf16-402c-9fee-2309b719cd91 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.209944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.212690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.220155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.220899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.221183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.221599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.222259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.224222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.236765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 855/1694] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:49.239990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:49.292855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 840/1695] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:49 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:49.298582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.314787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664188c4-85f3-4ceb-8635-9ae7a82e67a0 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.455477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.456234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.456430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.456762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.457434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.459470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fafb6-e1bc-411d-af81-66094ff282cf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.500750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 856/1696] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:49 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:49.504766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.519468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c903-bf10-4395-bef8-a916ae6cc5b2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.533286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.534045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.534359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.534785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.535479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.537346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.565843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.566132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.566405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.568322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 841/1697] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:49.574169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.591252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70938c0d-d734-44e0-80c9-6a74fa4c1299 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.603224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.604049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.604353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.604629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] PATH_INFO: `/v3/projects/eb57a955437c419d965cd98f0e36793f/users/3885020fdb174da9b91eb6d9d37501e4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.628608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] MFA Rules not processed for user `0c2b75a0f6a2403fa7d67ca3b8ea6285`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:49.632067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.636322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb57a955437c419d965cd98f0e36793f, user_id=3885020fdb174da9b91eb6d9d37501e4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.642360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.685402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 842/1698] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:49 2022] PUT /identity/v3/projects/eb57a955437c419d965cd98f0e36793f/users/3885020fdb174da9b91eb6d9d37501e4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:49.686374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.696148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.824273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 857/1699] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:49.826196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.866175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d45fd-ca39-49f9-9a61-9df93379a576 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.877239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.877793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578cdb-9672-4e56-b471-0b04d75ced06 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.877921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.878139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.878417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.879082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.880741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.893133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.893804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.894096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.898481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] PATH_INFO: `/v3/projects/72cae09d5e8e4f2a88591477e930557d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.899537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 858/1700] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:49.900570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:49.902822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cae09d5e8e4f2a88591477e930557d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.904847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:49.911258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:49.922904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:49.949130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0dbe-8dde-4eb6-80aa-f838cea9678d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:49.969347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:49.969999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:49.970279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:49.970551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] PATH_INFO: `/v3/projects/3259c340a539419896a1879c5da1f5a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:49.972033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3259c340a539419896a1879c5da1f5a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:49.984602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:50.022303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cae09d5e8e4f2a88591477e930557d', 'request_id': 'req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.034545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cae09d5e8e4f2a88591477e930557d', 'request_id': 'req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.049261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cae09d5e8e4f2a88591477e930557d', 'request_id': 'req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.091093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] The token cache is being invalidate because project 72cae09d5e8e4f2a88591477e930557d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:50.091705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.094362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b060ef2-b9ab-4851-bc1a-b8bed8debd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.101678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 843/1701] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:49 2022] DELETE /identity/v3/projects/72cae09d5e8e4f2a88591477e930557d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:50.104087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:50.105271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:50.107265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:50.112226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3259c340a539419896a1879c5da1f5a5', 'request_id': 'req-de9db5a3-216b-47e3-879f-47b6d008f68e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.136107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3259c340a539419896a1879c5da1f5a5', 'request_id': 'req-de9db5a3-216b-47e3-879f-47b6d008f68e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.153612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3259c340a539419896a1879c5da1f5a5', 'request_id': 'req-de9db5a3-216b-47e3-879f-47b6d008f68e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.155268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] MFA Rules not processed for user `0c2b75a0f6a2403fa7d67ca3b8ea6285`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:50.158664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.177985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] The token cache is being invalidate because project 3259c340a539419896a1879c5da1f5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:50.179493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.181662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.184620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 859/1702] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:49 2022] DELETE /identity/v3/projects/3259c340a539419896a1879c5da1f5a5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:50.194218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:50.200739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.300281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:50.352552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 844/1703] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:50.352552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:50.352552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.483196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db5a3-216b-47e3-879f-47b6d008f68e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:50.490468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:50.491209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:50.491493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:50.491763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] PATH_INFO: `/v3/projects/eb57a955437c419d965cd98f0e36793f/users/3885020fdb174da9b91eb6d9d37501e4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:50.495106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb57a955437c419d965cd98f0e36793f, user_id=3885020fdb174da9b91eb6d9d37501e4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:50.498043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a3010-0c28-4b24-a161-8b2187a32bd2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:50.513892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046aa44-2ab2-4f02-a033-5e320340b306 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:50.523547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 860/1704] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:50 2022] PUT /identity/v3/projects/eb57a955437c419d965cd98f0e36793f/users/3885020fdb174da9b91eb6d9d37501e4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:50.525124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:50.525577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:50.525919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:50.561757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:50.563003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.651174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:50.653285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:50.653575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:50.653922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] PATH_INFO: `/v3/users/2f9d93ec683c4c59bfb49b953f13ad62` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:50.661831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9d93ec683c4c59bfb49b953f13ad62)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:50.668200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:50.747559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 861/1705] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:50.748596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:50.752411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.792152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:50.839236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9d93ec683c4c59bfb49b953f13ad62'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.857423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9d93ec683c4c59bfb49b953f13ad62'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.883439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9d93ec683c4c59bfb49b953f13ad62'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.884635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9d93ec683c4c59bfb49b953f13ad62'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.886117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9d93ec683c4c59bfb49b953f13ad62'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:50.902860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a844ccb-e62e-4d1e-be33-c9f7c7893684 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:50.905285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 845/1706] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:50 2022] DELETE /identity/v3/users/2f9d93ec683c4c59bfb49b953f13ad62 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:50.906458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:50.920097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:50.955989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:51.021371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.022263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.023948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.024776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.027455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.079466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41420f64-0ade-4dff-8065-4b122b690a7f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.085341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.086761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.089647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.089647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] PATH_INFO: `/v3/projects/1074ec6233614cb89f29dfbea8a2f03c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.089647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1074ec6233614cb89f29dfbea8a2f03c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.091186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.169272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1074ec6233614cb89f29dfbea8a2f03c', 'request_id': 'req-5ec4a371-8ad4-4705-8b89-694baedf03be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.171267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.173844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a266ad-d522-4738-8d98-05e2fb68e036 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.181667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1074ec6233614cb89f29dfbea8a2f03c', 'request_id': 'req-5ec4a371-8ad4-4705-8b89-694baedf03be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.184883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 862/1707] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:51.196765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1074ec6233614cb89f29dfbea8a2f03c', 'request_id': 'req-5ec4a371-8ad4-4705-8b89-694baedf03be'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.213788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.214189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.214669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.218728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] The token cache is being invalidate because project 1074ec6233614cb89f29dfbea8a2f03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:51.219077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.220842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ec4a371-8ad4-4705-8b89-694baedf03be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.227094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 846/1708] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:50 2022] DELETE /identity/v3/projects/1074ec6233614cb89f29dfbea8a2f03c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:51.230651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7c0-8d1e-4812-b820-fa97a035f838 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.230872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7c0-8d1e-4812-b820-fa97a035f838 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.235677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7c0-8d1e-4812-b820-fa97a035f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.278006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-766bb7c0-8d1e-4812-b820-fa97a035f838 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:51.279259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-766bb7c0-8d1e-4812-b820-fa97a035f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.291407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] MFA Rules not processed for user `3885020fdb174da9b91eb6d9d37501e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:51.293022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.391867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:51.431709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 847/1709] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:51.433457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.433651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.433931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.460062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:51.462294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 863/1710] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:51.462637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.469388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:51.485927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 848/1711] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:51.486884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:51.488847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.492859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49be33c-c911-4c19-90c5-bd7746f9ad4d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.506477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.507448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.507932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.508418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.509101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:51.509415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.516039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769c173-4f44-4f62-8308-621d5fe5b8fd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.551211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 864/1712] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:51.552671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.553016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.553300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.582437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:51.587578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:51.592641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.611718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 865/1713] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:51.613264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:51.615474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:51.623116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceedd7f-533c-4d8a-8976-ae9b4d8baac1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.626938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.628178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.628458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.628832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.643873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.645999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.661546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9495-36d3-4026-b4d6-efbd71406b8c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.673007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.673809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.674152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.674620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] PATH_INFO: `/v3/projects/0b28141d01cd42ef92f601b6098c5f42` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.676936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28141d01cd42ef92f601b6098c5f42)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.679835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.682943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 849/1714] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:51.684241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:51.706253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1135-f661-4e0f-8a36-ab61b63205fa service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.712848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:51.713555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:51.713791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:51.713996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:51.714632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:51.717466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:51.774936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 850/1715] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:51 2022] POST /identity/v3/projects => generated 401 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:51.775937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:51.874812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28141d01cd42ef92f601b6098c5f42', 'request_id': 'req-454d98ce-7b06-4394-8206-a8a669127e5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.902410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28141d01cd42ef92f601b6098c5f42', 'request_id': 'req-454d98ce-7b06-4394-8206-a8a669127e5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:51.932472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e1d9-8b8f-4ef8-a091-fb282dc5d7c0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:51.966002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28141d01cd42ef92f601b6098c5f42', 'request_id': 'req-454d98ce-7b06-4394-8206-a8a669127e5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:52.031059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] The token cache is being invalidate because project 0b28141d01cd42ef92f601b6098c5f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:25:52.032427 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:52.033418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:52.035855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 866/1716] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:25:51 2022] DELETE /identity/v3/projects/0b28141d01cd42ef92f601b6098c5f42 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:52.038265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.047456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.224794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.225445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.225722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.225991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.227475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:52.227789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.229488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.261924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 851/1717] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:52.263278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.265249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.380066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d98ce-7b06-4394-8206-a8a669127e5c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.386506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.387247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.387516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.387776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.388417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.409244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9e5d-ae19-46a0-9e2d-bf968e1363e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.430864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6feb1-8cf8-4ec9-95c1-b94f1ef28f3c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.439452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.440115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.440393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.440687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.450407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.468315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 867/1718] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/users => generated 301 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:52.474140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:52.474623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bac51-da53-4bd6-9c07-9044a845f1ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.475095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bac51-da53-4bd6-9c07-9044a845f1ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.475266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bac51-da53-4bd6-9c07-9044a845f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.519969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8d1bac51-da53-4bd6-9c07-9044a845f1ae None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:52.521461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d1bac51-da53-4bd6-9c07-9044a845f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.541507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 868/1719] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:52.543118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.543571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.544538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.547236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 869/1720] 10.222.0.71 () {54 vars in 912 bytes} [Mon Sep 19 11:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:25:52.548683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.557469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.567470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.571655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.584859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 852/1721] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:52.589181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.595538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ea95b-c567-4591-afc8-6082c33d9f9b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.603692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.603692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.604176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.604556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.604864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ab16-22a7-438e-b2f6-eda3a6b1849f service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.605797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.608832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3af3-d745-4857-a76b-1330e32db534 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.619497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.620239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.620522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.620894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.621643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.623358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed226b4-e3ab-48d4-8c1c-b57a4a1f6eee admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.639101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 853/1722] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:52.640486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.640791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.641069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.677264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:52.678474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.691314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 870/1723] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:52.693396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.698110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.698901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 854/1724] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:52.699994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.700696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.720841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:52.721418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621051-32a6-450c-9511-b08dc8cbb9bd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.866230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:52.872391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:52.896540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.897210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.897549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.897921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.899051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.904711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:52.944474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 855/1725] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:52.944474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:52.967241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4aa070-657e-468c-8a33-e8c97cb239e5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:52.973547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:52.974441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:52.974912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:52.975449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:52.976491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:52.978868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.010835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 871/1726] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:53.012035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.013590 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 856/1727] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:52 2022] POST /identity/v3/users => generated 294 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:53.014616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.027097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d9019-d805-4e09-8fe6-6ae4f6c18595 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.032083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.033466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.033466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.033648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] PATH_INFO: `/v3/projects/3326ffb8d68f41f6b44209711ff3bb29/users/7261f746a9d7488a8abe900327a3bfa0/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.037888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dc79e-05e3-44ac-a988-658606dbb80a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.043686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.044719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.045150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.045560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.046350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:25:53.046792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.051133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.053800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3326ffb8d68f41f6b44209711ff3bb29, user_id=7261f746a9d7488a8abe900327a3bfa0, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.058374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.086224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 857/1728] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:53 2022] PUT /identity/v3/projects/3326ffb8d68f41f6b44209711ff3bb29/users/7261f746a9d7488a8abe900327a3bfa0/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:53.100634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.125844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 872/1729] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:25:53.134181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.137414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:53.154619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5c226-96c0-45cb-ad34-1e8630b059b5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.227685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:53.253447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.254067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.254346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.254616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.255727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61b97-5f66-4ff0-9c2d-b87fb99eb48e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.265952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.267405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b476-abaa-4f44-b998-9d7fdfa176df service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.274749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.276016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.276784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.277093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.277772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.279814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.290838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 873/1730] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:53.292489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.294478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.294766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.304113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 858/1731] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:53.305891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.322910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b5be8-5b99-4479-a53e-ce3b7517223a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.345863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.346589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.346967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.347339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.348087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.351511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.377874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] MFA Rules not processed for user `7261f746a9d7488a8abe900327a3bfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:53.378950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:53.414376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 859/1732] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:53 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:53.415465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.551565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 874/1733] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:53.552655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.563959 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a2c1-d1f8-4af1-be5c-7e314268f4a6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.578542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7ef96-65c9-4181-b000-144ba42c2bca None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.591552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.592429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.592975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.593440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.594235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.595982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.596242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.596903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.597179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.597443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.598095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.599996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.633511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 860/1734] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:53.634313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.639679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 875/1735] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:53 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:53.643671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.658557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:53.666113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07595f6-7505-4d6d-bc07-848caf4b1700 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.670107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205ed7-5cfc-4273-b81d-56eb2727aeb2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:53.678242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.678874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.679154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.680162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.681760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.683711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef6976-bbc1-4b85-a2b0-d5631856c402 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.685564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:53.686450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.686906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.687350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] PATH_INFO: `/v3/projects/91633bb1e4a34efe85c7b5962314b73c/users/db11c7e472e54b5e848268e36fdccf26/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.737805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91633bb1e4a34efe85c7b5962314b73c, user_id=db11c7e472e54b5e848268e36fdccf26, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:53.747275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:53.782829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 876/1736] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:53 2022] PUT /identity/v3/projects/91633bb1e4a34efe85c7b5962314b73c/users/db11c7e472e54b5e848268e36fdccf26/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:53.783889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:53.798101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 861/1737] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:53 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:53.798101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:53.798101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:53.798101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:53.865720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] MFA Rules not processed for user `db11c7e472e54b5e848268e36fdccf26`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:53.867023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:53.950183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a53704-488d-4c82-8f59-d1d6a050caf1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.140193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 862/1738] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:54.142878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.199256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.200213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.200849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.202063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.203278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.210762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.253039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 877/1739] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:54.254109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.268214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f39d6-f6db-47c6-9bd8-b3789928d8ec admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.275296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.276165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.276563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.276936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.277744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.280565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.322628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:54.358927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 878/1740] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:54.361270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.499455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4913-9c25-4e05-ac0e-8532d91f0d58 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.572829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ce2d-71a0-4dcb-8f0e-43a363f38eab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.596440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.600828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.606063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.610315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.610315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.623061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.625510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:54.660226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 879/1741] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:54.661443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.674599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d2e3-1b60-4c77-8217-510ddc42e835 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.680276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.682730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.682954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.683374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.685652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.686228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.687091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.687684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.691064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.691963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.699522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.700284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.740288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 880/1742] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:54 2022] POST /identity/v3/users => generated 299 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:54.743933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.769122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 863/1743] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:54 2022] POST /identity/v3/users => generated 308 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:54.771876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.775794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:54.777930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f60e-be1a-420d-a25e-6b3d9165291e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:54.787731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:54.789625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:54.790523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:54.790523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] PATH_INFO: `/v3/projects/913e9e8b0ea441028ba5978774524be1/users/b4314ef321fe40abb7866e2e7393ee5d/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:54.861503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913e9e8b0ea441028ba5978774524be1, user_id=b4314ef321fe40abb7866e2e7393ee5d, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:54.864172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:54.905196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 881/1744] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:54 2022] PUT /identity/v3/projects/913e9e8b0ea441028ba5978774524be1/users/b4314ef321fe40abb7866e2e7393ee5d/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:54.906304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:54.997473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52553f-806d-420b-8421-12fcff8d154b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.012805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a580c-4eee-4bb4-8961-99c71a9ac4d7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.026006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.026635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.026915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.027188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.027846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.029478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.051907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 882/1745] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:55.056074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:55.081254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83280f77-d852-4ebc-889a-cea7c91cd886 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.099026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.099656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.099934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.100203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.100884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.103067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb49bb-b2d7-4a74-b061-b0fe0cdcd5de admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.107334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.108008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.108299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.108616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.110756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:55.124756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.126400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9bc5b-d555-4bde-bf1a-18b72f17205a service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.131880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:55.146810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 883/1746] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:55.148164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.148454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.148774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.150268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 864/1747] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:55.151810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.155230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.155517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.214706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] MFA Rules not processed for user `0c2b75a0f6a2403fa7d67ca3b8ea6285`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:55.218716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:55.274010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] MFA Rules not processed for user `b4314ef321fe40abb7866e2e7393ee5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:55.275229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:55.359021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 884/1748] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:55.363534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:55.389895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46256e5-1d06-4c2a-a041-f51552c91d91 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.400271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.400989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.401270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.401540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] PATH_INFO: `/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89/users/8f40ff5886e64454a517d2637a783af1/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.450743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 865/1749] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:55.450925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccc3e3fb4ed42ddac665588200a1b89, user_id=8f40ff5886e64454a517d2637a783af1, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.454799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.456708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:55.498229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 885/1750] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:55 2022] PUT /identity/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89/users/8f40ff5886e64454a517d2637a783af1/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:55.498419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251856ea-4d4a-45b5-9b26-59ceb77a4b41 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.498513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:55.557673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:55.749036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.749567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.749791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.750099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] PATH_INFO: `/v3/projects/9529089a985c4bca97a0702ab20635f1/users/017caf74833b48b294062fe2f2e9cd28/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.782089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875cd3-6464-4e0d-a087-4fbd2226a1c1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:55.782835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9529089a985c4bca97a0702ab20635f1, user_id=017caf74833b48b294062fe2f2e9cd28, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.786111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.818646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:55.819594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 866/1751] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:55 2022] PUT /identity/v3/projects/9529089a985c4bca97a0702ab20635f1/users/017caf74833b48b294062fe2f2e9cd28/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:55.819817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:55.823105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:55.823461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:55.824375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:55.824517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:55.838583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:55.941845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 886/1752] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:25:55 2022] POST /identity/v3/projects => generated 387 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:55.943377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:56.049420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef836c6-4156-43b9-9e0c-cd449adf3076 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:56.091523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:56.199805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63608e-0e1e-4cf7-b44e-df61cb5bfc68 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:56.217289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:56.218059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.218343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.218658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.219314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:56.220997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8828d-4aa1-45c6-997b-aefc6211425f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:56.265705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 887/1753] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:56.267410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.269222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.269467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.273704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:56.278896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.279289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.279608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.280436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:56.282195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:56.313680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 867/1754] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:56.314406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:56.344881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9223e-16bb-4b71-b43e-57e47e6313f2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:56.363898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] MFA Rules not processed for user `bdb73bfe2c0141f6a18c50555dbfb662`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:56.367714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:56.368726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.369197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.369664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.370959 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:56.374799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c21666-a45a-4df3-b1e4-462de66c5d3b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:56.376423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:56.450302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 868/1755] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:25:56 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:25:56.452360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.456996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.457812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.573362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] MFA Rules not processed for user `0ae27430186b42b88d0ad7ba442fc7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:56.575438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:56.784649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 869/1756] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:56.784649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:56.795130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 888/1757] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:56.808569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:56.811718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265af6b-381b-4167-b3e7-822cc9338568 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:56.829059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:56.829746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:56.830026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:56.830302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] PATH_INFO: `/v3/projects/9529089a985c4bca97a0702ab20635f1/users/017caf74833b48b294062fe2f2e9cd28/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:56.845207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9529089a985c4bca97a0702ab20635f1, user_id=017caf74833b48b294062fe2f2e9cd28, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:56.862854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:56.890723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d178f-4595-4413-ba83-cd43e0ddece7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:56.916654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 870/1758] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:56 2022] PUT /identity/v3/projects/9529089a985c4bca97a0702ab20635f1/users/017caf74833b48b294062fe2f2e9cd28/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:56.916654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:57.024936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:57.145388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:57.146438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.146908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.149696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] PATH_INFO: `/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89/users/8f40ff5886e64454a517d2637a783af1/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.161381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccc3e3fb4ed42ddac665588200a1b89, user_id=8f40ff5886e64454a517d2637a783af1, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:57.175798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895e73c-b5bf-4f2a-8af0-4d6e559f9090 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:57.233342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76f67-d6f2-4e20-94de-beeff363c085 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:57.257016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 889/1759] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:56 2022] PUT /identity/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89/users/8f40ff5886e64454a517d2637a783af1/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:57.263527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1091b3-b01c-48b0-85ce-d9ed72d849bc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.264028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1091b3-b01c-48b0-85ce-d9ed72d849bc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.264459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1091b3-b01c-48b0-85ce-d9ed72d849bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.291244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:57.331353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0b1091b3-b01c-48b0-85ce-d9ed72d849bc None None] MFA Rules not processed for user `0ae27430186b42b88d0ad7ba442fc7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:57.337377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0b1091b3-b01c-48b0-85ce-d9ed72d849bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:57.430553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:57.433197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.434875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.435526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.439185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:57.446384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:57.491733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 871/1760] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 586 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:57.496714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:57.506865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:57.530160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 890/1761] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:57.550485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7672-308a-4932-87a1-ef5abd83ff85 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.553443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7672-308a-4932-87a1-ef5abd83ff85 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.554005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7672-308a-4932-87a1-ef5abd83ff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.628838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d8cb7672-308a-4932-87a1-ef5abd83ff85 None None] MFA Rules not processed for user `017caf74833b48b294062fe2f2e9cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:57.630239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d8cb7672-308a-4932-87a1-ef5abd83ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:57.667442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1533aef-8e34-46a3-908c-ef5f1aee31f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:57.689041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:57.689678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.689960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.690235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.857255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:57.867053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 891/1762] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:57.869119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:57.871959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:57.872748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:57.873893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:57.903445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 872/1763] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:57.904442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:57.972198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff397-1d7b-4dd2-918e-cf46d6da5362 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:58.000131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:58.000910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:58.001477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:58.001477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] PATH_INFO: `/v3/projects/2144b93a191e419ba9b7107b6a1ac462/users/62b50f410fbc473eaab61a80ed3bd9ef/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:58.014300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] MFA Rules not processed for user `8f40ff5886e64454a517d2637a783af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:58.024385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:58.056930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2144b93a191e419ba9b7107b6a1ac462, user_id=62b50f410fbc473eaab61a80ed3bd9ef, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:58.060407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:58.095245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 873/1764] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:57 2022] PUT /identity/v3/projects/2144b93a191e419ba9b7107b6a1ac462/users/62b50f410fbc473eaab61a80ed3bd9ef/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:58.095434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:58.103195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:58.202180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:58.255497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:58.335121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a7621-63f6-464f-9ea2-fd024ac34e8a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:58.347068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:58.348569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:58.349179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:58.350714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:58.364772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 892/1765] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:58.366000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:58.488533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:58.495170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:58.526202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 874/1766] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:58.527524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a063c61-226d-40d4-82dc-92e27a07deb6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:58.528772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:58.720113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:58.724312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:58.724312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:58.724312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:58.833407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b92c-43aa-4bc1-a0c8-5bdb1246a45f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:58.852661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:58.853298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:58.853298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:58.853508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:58.855209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:58.864607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:58.877127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:58.879364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:58.908976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 893/1767] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:58 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:58.910183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:58.912831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:58.928739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 875/1768] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:25:58.930108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:58.935949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409ee8-8384-4527-a7ae-f105cbc08da2 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:58.941263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:58.956131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:58.957837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:58.958567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:58.986491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ab70-9737-482c-8a75-1576e629417a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:59.001828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:59.003564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:59.006456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:59.008084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] PATH_INFO: `/v3/projects/2144b93a191e419ba9b7107b6a1ac462/users/62b50f410fbc473eaab61a80ed3bd9ef/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:59.019027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2144b93a191e419ba9b7107b6a1ac462, user_id=62b50f410fbc473eaab61a80ed3bd9ef, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:59.030809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf4124-9b83-474d-b387-891e9dd7a276 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:59.047829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 876/1769] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:25:58 2022] PUT /identity/v3/projects/2144b93a191e419ba9b7107b6a1ac462/users/62b50f410fbc473eaab61a80ed3bd9ef/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:59.076564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948a7b-e1b8-40a5-be26-e47da568ee2d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:59.076876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948a7b-e1b8-40a5-be26-e47da568ee2d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:59.077175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948a7b-e1b8-40a5-be26-e47da568ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:59.082901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:59.159143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:59.160446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:59.173608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-83948a7b-e1b8-40a5-be26-e47da568ee2d None None] MFA Rules not processed for user `62b50f410fbc473eaab61a80ed3bd9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:59.176263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-83948a7b-e1b8-40a5-be26-e47da568ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:59.201973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 894/1770] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:59.279605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:59.283644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:59.307825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae13cc4-e465-4ebd-8b53-846970fbd495 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:59.389916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 877/1771] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:59.391248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:59.391520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:59.391750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:59.538475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:25:59.540250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:59.628658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:59.630295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:59.630627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:59.630855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] PATH_INFO: `/v3/users/db11c7e472e54b5e848268e36fdccf26` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:59.643765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db11c7e472e54b5e848268e36fdccf26)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:59.645764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:59.694216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 878/1772] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:25:59.695957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:59.842977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db11c7e472e54b5e848268e36fdccf26'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:59.843867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db11c7e472e54b5e848268e36fdccf26'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:59.871910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db11c7e472e54b5e848268e36fdccf26'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:59.890984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db11c7e472e54b5e848268e36fdccf26'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:59.892290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db11c7e472e54b5e848268e36fdccf26'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:25:59.909863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9afe-1b81-41f2-93e3-ea8306922d50 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:59.913495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 895/1773] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:59 2022] DELETE /identity/v3/users/db11c7e472e54b5e848268e36fdccf26 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:25:59.914547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:59.916268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.016014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd112ca-918b-4579-a64a-3259837f25c0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:00.027756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:00.028512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.028954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.029168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] PATH_INFO: `/v3/users/7261f746a9d7488a8abe900327a3bfa0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:00.031330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7261f746a9d7488a8abe900327a3bfa0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:00.034362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:00.036474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:00.096484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:00.097366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.097786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.098158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:00.101588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.166734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:00.181217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7261f746a9d7488a8abe900327a3bfa0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:00.182945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7261f746a9d7488a8abe900327a3bfa0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:00.213858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7261f746a9d7488a8abe900327a3bfa0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:00.280298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7261f746a9d7488a8abe900327a3bfa0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:00.281936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2f1e27a9-2220-4890-a9a4-d859e04d8ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7261f746a9d7488a8abe900327a3bfa0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:00.328485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 896/1774] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:25:59 2022] DELETE /identity/v3/users/7261f746a9d7488a8abe900327a3bfa0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:00.342769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae995-200d-42c8-865d-9d783f505bea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.348803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae995-200d-42c8-865d-9d783f505bea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.349879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae995-200d-42c8-865d-9d783f505bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:00.381834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:00.388571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:00.418092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-248ae995-200d-42c8-865d-9d783f505bea None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:00.421225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-248ae995-200d-42c8-865d-9d783f505bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.427437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 879/1775] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:00.428532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:00.437101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.643294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 897/1776] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:00.652855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.653786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.656742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:00.714490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916d49-f836-4669-a3e4-ebaad11f80c1 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:00.729616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:00.732216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.760825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 898/1777] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:00.761941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:00.767103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.952713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:00.953790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.957286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.957998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1808fda-2329-4cfa-8009-d743367b2e01 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:00.960197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:00.968070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:00.993928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:00.994616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:00.994835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:00.995121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:01.010769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:01.017831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:01.084386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 899/1778] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:01.090139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:01.103494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:01.129281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:01.147223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a747-dae3-487e-961e-a5fc1e4db037 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:01.165313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:01.165661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:01.165874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:01.166142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:01.213091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:01.213091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8dba1-e600-422b-ac60-e9c0a05ad794 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:01.247923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:01.249719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:01.263870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 880/1779] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:26:01.265815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:01.269358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:01.273839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 900/1780] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:01.301475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0e6-71c1-487c-81cf-7798d29475d6 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:01.312381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:01.313180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:01.313570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:01.313946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] PATH_INFO: `/v3/users/b4314ef321fe40abb7866e2e7393ee5d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:01.315784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4314ef321fe40abb7866e2e7393ee5d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:01.326105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:01.590799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4314ef321fe40abb7866e2e7393ee5d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:01.647406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4314ef321fe40abb7866e2e7393ee5d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:01.729354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4314ef321fe40abb7866e2e7393ee5d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:01.731977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4314ef321fe40abb7866e2e7393ee5d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:01.733567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4314ef321fe40abb7866e2e7393ee5d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:01.776804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 881/1781] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:01 2022] DELETE /identity/v3/users/b4314ef321fe40abb7866e2e7393ee5d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:01.781750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-44f1-48af-b6a8-88d6dae1b64d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:01.782214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-44f1-48af-b6a8-88d6dae1b64d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:01.782693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a1a6f-44f1-48af-b6a8-88d6dae1b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:01.799199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:01.857696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d34a1a6f-44f1-48af-b6a8-88d6dae1b64d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:01.862060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d34a1a6f-44f1-48af-b6a8-88d6dae1b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:02.106850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 901/1782] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:02.873147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:02.874839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:03.091570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72dd5-de83-494c-98c0-ea648b92b946 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:03.103017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:03.103848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:03.107936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:03.108507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:03.134173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:03.161387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:03.205383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 882/1783] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:03.426523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:03.430034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:03.430034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:03.495651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:03.497377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:03.511245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:03.518820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:03.533732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210952f-0ca3-462c-81ca-e3f428d9095c service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:03.544050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:03.545509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:03.545963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:03.546693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] PATH_INFO: `/v3/projects/91633bb1e4a34efe85c7b5962314b73c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:03.565144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 902/1784] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Sep 19 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:03.588533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91633bb1e4a34efe85c7b5962314b73c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:03.595060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:03.817366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:03.826867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:03.839924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590172-fcf2-4a5c-a433-b164d43754d3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:03.866998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91633bb1e4a34efe85c7b5962314b73c', 'request_id': 'req-6bb786ba-bd67-4961-9030-1d7034cba054'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:03.909904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91633bb1e4a34efe85c7b5962314b73c', 'request_id': 'req-6bb786ba-bd67-4961-9030-1d7034cba054'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:03.941530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91633bb1e4a34efe85c7b5962314b73c', 'request_id': 'req-6bb786ba-bd67-4961-9030-1d7034cba054'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.000952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] The token cache is being invalidate because project 91633bb1e4a34efe85c7b5962314b73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:04.001252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.011284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.019173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 883/1785] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:03 2022] DELETE /identity/v3/projects/91633bb1e4a34efe85c7b5962314b73c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:04.020282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:04.032505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:04.070026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:04.073634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:04.076672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:04.079326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:04.092164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:04.132043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:04.136570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:04.157395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 903/1786] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:04.159138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:04.162147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:04.345644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb786ba-bd67-4961-9030-1d7034cba054 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:04.359019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:04.359999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:04.360637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:04.360950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] PATH_INFO: `/v3/projects/3326ffb8d68f41f6b44209711ff3bb29` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:04.364265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3326ffb8d68f41f6b44209711ff3bb29)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:04.372789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:04.477578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68581ce-1f33-44d2-884a-1a4bbe8f01bd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:04.489922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3326ffb8d68f41f6b44209711ff3bb29', 'request_id': 'req-48a6648f-a5e5-4483-a2a7-592da99acdaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.511134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3326ffb8d68f41f6b44209711ff3bb29', 'request_id': 'req-48a6648f-a5e5-4483-a2a7-592da99acdaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.528860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3326ffb8d68f41f6b44209711ff3bb29', 'request_id': 'req-48a6648f-a5e5-4483-a2a7-592da99acdaa'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.562496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] The token cache is being invalidate because project 3326ffb8d68f41f6b44209711ff3bb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:04.562981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.565418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.570754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 884/1787] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:04 2022] DELETE /identity/v3/projects/3326ffb8d68f41f6b44209711ff3bb29 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:04.575233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:04.576697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:04.680779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:04.744455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:04.748126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:04.750482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:04.752303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] PATH_INFO: `/v3/users/8f40ff5886e64454a517d2637a783af1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:04.758602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f40ff5886e64454a517d2637a783af1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:04.765336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:04.924324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f40ff5886e64454a517d2637a783af1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.925401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f40ff5886e64454a517d2637a783af1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.942159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f40ff5886e64454a517d2637a783af1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.954492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6648f-a5e5-4483-a2a7-592da99acdaa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:04.977808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f40ff5886e64454a517d2637a783af1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.979361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f40ff5886e64454a517d2637a783af1'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:04.981237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:04.981909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:04.982197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:04.987128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] PATH_INFO: `/v3/users/017caf74833b48b294062fe2f2e9cd28` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:04.989115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] RBAC: Authorizing `identity:delete_user(user_id=017caf74833b48b294062fe2f2e9cd28)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:04.998880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:05.004747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 904/1788] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:04 2022] DELETE /identity/v3/users/8f40ff5886e64454a517d2637a783af1 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:05.015470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:05.132996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017caf74833b48b294062fe2f2e9cd28'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:05.161089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017caf74833b48b294062fe2f2e9cd28'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:05.218882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017caf74833b48b294062fe2f2e9cd28'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:05.220135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017caf74833b48b294062fe2f2e9cd28'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:05.220888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017caf74833b48b294062fe2f2e9cd28'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:05.256046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 885/1789] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:04 2022] DELETE /identity/v3/users/017caf74833b48b294062fe2f2e9cd28 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:07.253429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:07.255615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:07.443194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880fa2-4270-47ea-85ca-3fb8bd572883 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:07.626492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:07.628961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:07.655023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:07.655984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:07.658120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:07.660265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] PATH_INFO: `/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:07.666946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccc3e3fb4ed42ddac665588200a1b89)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:07.675380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:07.737949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:07.830093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccc3e3fb4ed42ddac665588200a1b89', 'request_id': 'req-f491a298-0d45-44c6-b267-1a05216e742a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:07.858631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccc3e3fb4ed42ddac665588200a1b89', 'request_id': 'req-f491a298-0d45-44c6-b267-1a05216e742a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:07.859637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7153020-98a7-404d-98db-5e5f307f12df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:07.886166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccc3e3fb4ed42ddac665588200a1b89', 'request_id': 'req-f491a298-0d45-44c6-b267-1a05216e742a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:07.924034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] The token cache is being invalidate because project 2ccc3e3fb4ed42ddac665588200a1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:07.925228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:07.928250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f491a298-0d45-44c6-b267-1a05216e742a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:07.979176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 905/1790] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:07 2022] DELETE /identity/v3/projects/2ccc3e3fb4ed42ddac665588200a1b89 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:07.984209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:07.984493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:07.984777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.021873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:08.023950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.024485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.024956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] PATH_INFO: `/v3/projects/913e9e8b0ea441028ba5978774524be1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.026415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] RBAC: Authorizing `identity:delete_project(project_id=913e9e8b0ea441028ba5978774524be1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:08.029073 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:08.036668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:08.041036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.069348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 906/1791] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:08.069348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:08.069348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.104250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ea52-dd4f-4c57-8e65-65008d39b80c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:08.119484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:08.120222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.120468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.126142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] PATH_INFO: `/v3/projects/9529089a985c4bca97a0702ab20635f1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.141213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9529089a985c4bca97a0702ab20635f1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:08.141213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:08.179294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:08.246633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913e9e8b0ea441028ba5978774524be1', 'request_id': 'req-b6e2fa4f-8326-4c45-9174-96734c4b078d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.274448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913e9e8b0ea441028ba5978774524be1', 'request_id': 'req-b6e2fa4f-8326-4c45-9174-96734c4b078d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.312926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913e9e8b0ea441028ba5978774524be1', 'request_id': 'req-b6e2fa4f-8326-4c45-9174-96734c4b078d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.327374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9529089a985c4bca97a0702ab20635f1', 'request_id': 'req-ab0b8106-c6ed-407e-90c5-dd81fb944202'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.347915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9529089a985c4bca97a0702ab20635f1', 'request_id': 'req-ab0b8106-c6ed-407e-90c5-dd81fb944202'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.365804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9529089a985c4bca97a0702ab20635f1', 'request_id': 'req-ab0b8106-c6ed-407e-90c5-dd81fb944202'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.379535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] The token cache is being invalidate because project 913e9e8b0ea441028ba5978774524be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:08.387060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.403508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b6e2fa4f-8326-4c45-9174-96734c4b078d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.412734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 886/1792] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:07 2022] DELETE /identity/v3/projects/913e9e8b0ea441028ba5978774524be1 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:08.416130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b169-bfaf-40b9-bac7-f002f45b0a1a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.420997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b169-bfaf-40b9-bac7-f002f45b0a1a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.421929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b169-bfaf-40b9-bac7-f002f45b0a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.422604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] The token cache is being invalidate because project 9529089a985c4bca97a0702ab20635f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:08.427262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.430716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab0b8106-c6ed-407e-90c5-dd81fb944202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.444147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 907/1793] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:08 2022] DELETE /identity/v3/projects/9529089a985c4bca97a0702ab20635f1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:08.445723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.446007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.446323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.502018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7257b169-bfaf-40b9-bac7-f002f45b0a1a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:08.507919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7257b169-bfaf-40b9-bac7-f002f45b0a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.568933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] MFA Rules not processed for user `bdb73bfe2c0141f6a18c50555dbfb662`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:08.584003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.778653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 908/1794] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:08.781345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:08.785249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.821690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664dcb9-277d-4170-8e4b-f8905e106af2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:08.827868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:08.828650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.828939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.829217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] PATH_INFO: `/v3/users/62b50f410fbc473eaab61a80ed3bd9ef` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.830497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b50f410fbc473eaab61a80ed3bd9ef)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:08.833699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:08.833841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 887/1795] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:08.834980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:08.835269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:08.836219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:08.887963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:08.909727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:08.915667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:08.950120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 888/1796] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:08.951642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:08.965976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b50f410fbc473eaab61a80ed3bd9ef'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.966749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b50f410fbc473eaab61a80ed3bd9ef'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:08.983132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c3eaf-187b-4ad7-8f7b-3e680dfd3a6a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.007020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.007803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.008309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.008864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.009729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:09.010254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:09.012080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040710d7-fc42-4f13-9135-6c52014949af admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:09.019179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b50f410fbc473eaab61a80ed3bd9ef'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:09.061460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 889/1797] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:09.062900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.063318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.063693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.099140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b50f410fbc473eaab61a80ed3bd9ef'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:09.104354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b50f410fbc473eaab61a80ed3bd9ef'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:09.129687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:09.133798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:09.164644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 890/1798] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:09.167376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.170397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:09.172980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 909/1799] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:08 2022] DELETE /identity/v3/users/62b50f410fbc473eaab61a80ed3bd9ef => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:09.174046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.212472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1d30f-1831-4653-9e49-34e30d8ffa64 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.392619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.393984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.394860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.395673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.404273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac037-feea-4f93-a8ea-a83e93a96781 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.409456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.409932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:09.410090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.410397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.410957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.411282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:09.411583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:09.413233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:09.414994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9c19-ce08-4827-b771-84a1f35b0f02 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:09.432485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 910/1800] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:09.436536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.450604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea03e-6c6b-4f60-aae4-b5628ca1cbac admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.469137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 891/1801] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/projects => generated 389 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:09.474855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062ab-6a3f-4a27-bc48-54efe5f2f501 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.475205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062ab-6a3f-4a27-bc48-54efe5f2f501 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.475533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4062ab-6a3f-4a27-bc48-54efe5f2f501 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.478300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 892/1802] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:26:09.479170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.479334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4062ab-6a3f-4a27-bc48-54efe5f2f501 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.480236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.480640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.481060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.481804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:09.483847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad44b81-0c04-4fe3-acbe-50b4439b157a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:09.538933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:09.558138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 911/1803] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:09.559527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.559917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.560304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.609778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:09.611156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:09.649991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4062ab-6a3f-4a27-bc48-54efe5f2f501 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.769290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:09.795776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 912/1804] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:09.797507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.843762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.844447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:09.844889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:09.844982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:09.846237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:09.862230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:09.932506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 893/1805] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/users => generated 295 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:09.934828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:09.969481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2d97-d096-4ae1-9232-15252f959bca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.992443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38797c5b-42ae-480d-83c1-afa0c857914f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:09.995612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:09.997262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.000362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.002054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.003796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.009556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.020230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.025851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.026457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.027168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.028652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.031904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.036553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 894/1806] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:10.037919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.052451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c679-2443-41a1-ae41-23543854b849 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.062574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.063630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.064078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.064518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.065512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.068004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.096558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 895/1807] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:10.100279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 913/1808] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:09 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:10.102687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.105676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.124085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536cfd3-c64e-43f0-ad09-61b6346b8fcf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.126168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb63ff-df19-4350-a703-8724934881f3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.131954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.132775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.133431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.133931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.134962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.135335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.136322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.137331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.137598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.138040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] PATH_INFO: `/v3/projects/4aae4cba334b454d94b5a593b38784ed/users/65e6b84b565042fda0cda40ecf9baeda/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.155403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 914/1809] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:10.157177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.166578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aae4cba334b454d94b5a593b38784ed, user_id=65e6b84b565042fda0cda40ecf9baeda, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.169859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e642ce1-7032-43de-a6ad-57137b8c571b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.181112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde16c-0d34-4593-b2bf-260263f962b0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.212720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 896/1810] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:10 2022] PUT /identity/v3/projects/4aae4cba334b454d94b5a593b38784ed/users/65e6b84b565042fda0cda40ecf9baeda/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:10.216892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.217132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.217390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.297215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] MFA Rules not processed for user `65e6b84b565042fda0cda40ecf9baeda`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:10.298617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:10.330440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.332770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.332770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.332770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.333613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.335263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.353095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 915/1811] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:10.354322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.382098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181752-1cf5-42b5-a25e-38c2860252fd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.412288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.415494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.419358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.419358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] PATH_INFO: `/v3/projects/83ab8b4df44344ae89346c4557d14aa1/users/431f1cdc5f7542709dcfe38a6674a144/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.501352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ab8b4df44344ae89346c4557d14aa1, user_id=431f1cdc5f7542709dcfe38a6674a144, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.518797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe1109-478b-4df9-8268-c41963f7ace3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.561559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:10.577173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 897/1812] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:10.578095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 916/1813] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:10 2022] PUT /identity/v3/projects/83ab8b4df44344ae89346c4557d14aa1/users/431f1cdc5f7542709dcfe38a6674a144/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:10.581376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.592621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.592621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.592621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.640278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06072-c8bc-478a-b01a-ac67e61b9070 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.688047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] MFA Rules not processed for user `431f1cdc5f7542709dcfe38a6674a144`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:10.689181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:10.813128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:10.860524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.861268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.861955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.864134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.866149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.878775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b146187-cbf2-468c-8050-9773f38a57aa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.891343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 917/1814] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:10.891343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:10.908406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:10.937829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f760e-3c10-4572-8a9b-3c7c04046154 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:10.950079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:10.950781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.951093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.951331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] PATH_INFO: `/v3/projects/2144b93a191e419ba9b7107b6a1ac462` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.953550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2144b93a191e419ba9b7107b6a1ac462)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:10.955470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:10.983506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 898/1815] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:10 2022] POST /identity/v3/projects => generated 389 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:10.985835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb2d1-d8ac-47ff-ba73-baa55353fde8 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:10.986129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb2d1-d8ac-47ff-ba73-baa55353fde8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:10.986408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb2d1-d8ac-47ff-ba73-baa55353fde8 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:10.988824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 899/1816] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:26:10.991489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb2d1-d8ac-47ff-ba73-baa55353fde8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.072067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2144b93a191e419ba9b7107b6a1ac462', 'request_id': 'req-ac807c52-bec5-460d-a753-d15146318e93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:11.088727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2144b93a191e419ba9b7107b6a1ac462', 'request_id': 'req-ac807c52-bec5-460d-a753-d15146318e93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:11.102339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2144b93a191e419ba9b7107b6a1ac462', 'request_id': 'req-ac807c52-bec5-460d-a753-d15146318e93'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:11.107651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb2d1-d8ac-47ff-ba73-baa55353fde8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.130603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] The token cache is being invalidate because project 2144b93a191e419ba9b7107b6a1ac462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:11.130903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:11.133478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:11.143571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 918/1817] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:10 2022] DELETE /identity/v3/projects/2144b93a191e419ba9b7107b6a1ac462 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:11.143571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.143571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.244286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.244992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.245393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.245784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.246400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.253733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.327058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 900/1818] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:11.327966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.330050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.377521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac807c52-bec5-460d-a753-d15146318e93 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.391901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:11.511786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac883-fd61-47b5-854c-cc4acf5a30cf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.518040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:11.519781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.520689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.521276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.522655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.528927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.532100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e74db-ea61-4517-bf52-173c02276879 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.552719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.553590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.553935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.554404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.556470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.579549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.582893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078cf9-1480-4921-93d9-86d2c7e4dfc3 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.596321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 901/1819] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/users => generated 301 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:11.599666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 919/1820] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:11.602075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.602537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.603092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.616330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.619584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.619965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.630289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:11.631828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.641597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 920/1821] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:11.642975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.644884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.661503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c67b-ab1f-4b83-adc5-02da6e024c6a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.670788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.671583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.672109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.672489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.674046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.676521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9ceb4-f38f-4947-a402-87e2f6dff14c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.685244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:11.686530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.707824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 902/1822] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:11.708784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.715736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 921/1823] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/users => generated 295 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:11.715736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.715736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.715736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.733880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779af1c6-237a-4a4b-a449-c00a1205a309 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.748497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:11.750019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:11.750387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.751064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.751365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.751623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.752282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.754080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.764168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 922/1824] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:11.765419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.777548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36644a8-5c07-4d36-a4f9-ae8610d14d79 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.786844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.787421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 903/1825] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:11.787612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.787784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.788071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.788983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.792045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.798218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.816040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 923/1826] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:11.818997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.833300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff406c25-fd81-46dc-aa18-e6c8ee014703 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.847179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebfbd-1a75-4c36-a50e-d026892ed0e9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:11.849062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.851758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.852053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.853624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.854987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:11.855170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:11.855483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.856981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:11.857293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:11.857640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] PATH_INFO: `/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa/users/86a1d127a4c6442aa5aba3595eec476f/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:11.869778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.885779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b17f2fdb104487f80b48c7e9a9d0dfa, user_id=86a1d127a4c6442aa5aba3595eec476f, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:11.903471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:11.934010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 904/1827] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:11.934235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.944096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 924/1828] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:11 2022] PUT /identity/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa/users/86a1d127a4c6442aa5aba3595eec476f/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:11.946152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:11.958316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0850b-3300-4dcd-90ef-63cfc0906da3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.096614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.096614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.096614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.096614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] PATH_INFO: `/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d/users/038e2c94e5224249b2ce4396dec6dcf7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.098003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e6b14-07e9-4164-936d-26e51f503522 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.106969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.108983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.109767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.110794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.112440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.127187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.143041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4ed0074e8949b689f46d7958e9bf5d, user_id=038e2c94e5224249b2ce4396dec6dcf7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.151205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.175364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 905/1829] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:11 2022] PUT /identity/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d/users/038e2c94e5224249b2ce4396dec6dcf7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:12.180356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.196740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 925/1830] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:11 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:12.197387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.336892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac2969-a92f-4f4c-b7e0-3df3c4b7d77e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.371158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.376636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.383613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.384403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.387531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.392359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda36f-7906-43f9-bd3e-9aeed83a1933 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.395570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.400535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:12.416773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.417406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.417690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.417966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.418674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.436375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.441451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 906/1831] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:12.442581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.469387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 926/1832] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:12.474124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.479975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:12.482893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251c7a-c7f1-4848-9ca5-c0d470771b61 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.500124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.500874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.501257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.501700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:12.502092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.505555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.511217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.576766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 907/1833] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:12 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:12.578038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.605597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d7f7-b10f-4a0f-94a0-303fca90cc8a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.619244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.621109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.622680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.622988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] PATH_INFO: `/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa/users/86a1d127a4c6442aa5aba3595eec476f/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.629790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b17f2fdb104487f80b48c7e9a9d0dfa, user_id=86a1d127a4c6442aa5aba3595eec476f, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.636151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.697998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 908/1834] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:12 2022] PUT /identity/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa/users/86a1d127a4c6442aa5aba3595eec476f/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:12.700373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.780218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caaf5d-93db-4e3f-aa2c-c8056753f47b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.789824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08bdb-95d0-4664-9993-bfd5eaf4431e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:12.809266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.809266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.809266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.809266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] PATH_INFO: `/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d/users/038e2c94e5224249b2ce4396dec6dcf7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.809620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4ed0074e8949b689f46d7958e9bf5d, user_id=038e2c94e5224249b2ce4396dec6dcf7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.811031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:12.843019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 909/1835] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:12 2022] PUT /identity/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d/users/038e2c94e5224249b2ce4396dec6dcf7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:12.856195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:12.962960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:12.963591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:12.963874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:12.964149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:12.996216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:12.997772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bb86a-8069-44e3-a91e-07c70c800ba8 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:13.034490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 927/1836] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:13.039208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265690-d9ef-4c98-a250-96e168141a50 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:13.041279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.041561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.041829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.070605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:13.071472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.071830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.072144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.074603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:13.075676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acf272-dbdc-4062-9f5a-92139fbfbfd7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:13.121617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 910/1837] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:13.138306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.138306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.138619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.165654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] MFA Rules not processed for user `86a1d127a4c6442aa5aba3595eec476f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:13.174000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:13.275430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] MFA Rules not processed for user `038e2c94e5224249b2ce4396dec6dcf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:13.278636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:13.402857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:13.413624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 928/1838] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:13.425150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:13.471584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a5c5-c9b1-497a-9f0d-2b6e28a9ef3c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:13.484110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:13.485426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.485846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.486381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.488070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:13.492782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:13.504036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:13.516731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 929/1839] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:13.516731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:13.520305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:13.549973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 911/1840] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:13.551001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:13.571282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9866fb6-38cc-4853-a3d8-a3e2384672f7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:13.577206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:13.578082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.578404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.578892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] PATH_INFO: `/v3/projects/726f9b22598140c5b84325a9dc09e9e3/users/d9d4c256278940479ab02045297ae420/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.596257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=726f9b22598140c5b84325a9dc09e9e3, user_id=d9d4c256278940479ab02045297ae420, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:13.599741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:13.628688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 912/1841] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:13 2022] PUT /identity/v3/projects/726f9b22598140c5b84325a9dc09e9e3/users/d9d4c256278940479ab02045297ae420/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:13.628688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:13.635044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:13.692675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edef05a-6f7c-430f-b866-18f8ce0f16c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:13.748379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83c88-391c-4fdd-9a7d-e6c34f324eba admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:13.756378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:13.759152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.759597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.760015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.762953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:13.868721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:13.869599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.869801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.870126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:13.936005 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:13.938635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860002e-8876-4ff9-a884-7ab2e9ada0b9 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:13.967494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 913/1842] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:13.980812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934148-b63d-441c-af09-db0083cc163e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:13.982583 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934148-b63d-441c-af09-db0083cc163e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:13.982942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934148-b63d-441c-af09-db0083cc163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.031735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-22934148-b63d-441c-af09-db0083cc163e None None] MFA Rules not processed for user `d9d4c256278940479ab02045297ae420`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:14.032741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.033577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22934148-b63d-441c-af09-db0083cc163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:14.034889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.052302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 930/1843] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:14.122255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:14.127161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 914/1844] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:14.131950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.233926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d5cc9-dcac-4f6f-9134-28d4168e1aa7 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.245311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.245934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.246365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.246566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.247165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.250708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.269166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:14.289386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 931/1845] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:14 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:14.293435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934148-b63d-441c-af09-db0083cc163e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.322058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934148-b63d-441c-af09-db0083cc163e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.416203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.416990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.417331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.417710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.420632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.420632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.469197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 915/1846] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:14 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:14.473145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.488131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890224b-625d-47d1-92e0-cd2be48db0ee admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.496122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.497015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.497380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.497958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.499176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.501392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.520613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 932/1847] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:14.525608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.536559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.542130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a62a4b-2394-44cc-9f30-17ba00e7a134 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.554509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c311-0371-44d0-b3f4-ecf8adae3295 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.558127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.558846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.559131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.559485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] PATH_INFO: `/v3/projects/947b246ca72445bfab71ecc6058423c0/users/d315d30ed6024b72acd6f693d3163296/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.565421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.566081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.566421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.566633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] PATH_INFO: `/v3/users/65e6b84b565042fda0cda40ecf9baeda` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.567880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e6b84b565042fda0cda40ecf9baeda)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.570717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.591954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947b246ca72445bfab71ecc6058423c0, user_id=d315d30ed6024b72acd6f693d3163296, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.596212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.620454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 916/1848] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:14 2022] PUT /identity/v3/projects/947b246ca72445bfab71ecc6058423c0/users/d315d30ed6024b72acd6f693d3163296/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:14.625028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.643739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e6b84b565042fda0cda40ecf9baeda'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:14.644855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e6b84b565042fda0cda40ecf9baeda'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:14.654297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e6b84b565042fda0cda40ecf9baeda'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:14.680256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e6b84b565042fda0cda40ecf9baeda'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:14.681799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9888bc35-27de-4737-89c4-072d861a2758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e6b84b565042fda0cda40ecf9baeda'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:14.712541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 933/1849] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:14 2022] DELETE /identity/v3/users/65e6b84b565042fda0cda40ecf9baeda => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:14.714133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.714423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.714717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.738915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf092e-115d-4303-830b-949aead2e044 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.746917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:14.748172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:14.823756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 934/1850] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:14.832610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.832610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.832965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.833165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.833819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.835538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.849532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.851607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:14.856125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 917/1851] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:14.861354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:14.864661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:14.884204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4c69-8f6a-419d-a763-fc4820dba03a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.889529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.890285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.890696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.890985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] PATH_INFO: `/v3/projects/947b246ca72445bfab71ecc6058423c0/users/d315d30ed6024b72acd6f693d3163296/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.893484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947b246ca72445bfab71ecc6058423c0, user_id=d315d30ed6024b72acd6f693d3163296, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:14.896837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354704d-5c79-497e-b6bf-31fc04262402 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:14.900619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:14.912291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 918/1852] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:14 2022] PUT /identity/v3/projects/947b246ca72445bfab71ecc6058423c0/users/d315d30ed6024b72acd6f693d3163296/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:14.923852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.924133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.924403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:14.931856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba7ab0-4ed7-4df5-a7b6-2e595d342cdb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:14.936980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:14.955933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] MFA Rules not processed for user `d315d30ed6024b72acd6f693d3163296`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:14.957235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:14.985784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:14.986309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:14.986662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:14.987054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:15.040674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 919/1853] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:15.051454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:15.051601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:15.052841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:15.053238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:15.067553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 935/1854] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:15.129287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0deb-982d-41c9-beb7-d40e43c59796 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:15.133887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:15.134558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:15.134900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:15.135235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:15.146208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:15.147934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:15.159467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 920/1855] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:15.580115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:15.582238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:15.600072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f07-84c5-4189-9e0f-f7af4e3a538a service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:15.602137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:15.603436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:15.603649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:15.604120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:15.604396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:15.604695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:15.606664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:15.641811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890343-0d64-413a-8ef7-f0ec8738bb7e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:15.654765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:15.655750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:15.656214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:15.656705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] PATH_INFO: `/v3/projects/4aae4cba334b454d94b5a593b38784ed` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:15.659501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aae4cba334b454d94b5a593b38784ed)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:15.662186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:15.703210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:15.705728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:15.732846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 936/1856] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:15.738486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aae4cba334b454d94b5a593b38784ed', 'request_id': 'req-962a150f-2624-4602-96f6-51c891a72bf6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:15.764294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aae4cba334b454d94b5a593b38784ed', 'request_id': 'req-962a150f-2624-4602-96f6-51c891a72bf6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:15.781625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aae4cba334b454d94b5a593b38784ed', 'request_id': 'req-962a150f-2624-4602-96f6-51c891a72bf6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:15.802672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] The token cache is being invalidate because project 4aae4cba334b454d94b5a593b38784ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:15.803415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:15.807614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:15.810814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 921/1857] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:15 2022] DELETE /identity/v3/projects/4aae4cba334b454d94b5a593b38784ed => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:15.815283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:15.830580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079938a-77cd-46c4-a8f0-280898f9b70e service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:15.931686 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:15.951854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:15.953682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:15.954278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:15.954676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] PATH_INFO: `/v3/users/86a1d127a4c6442aa5aba3595eec476f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:15.968987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a1d127a4c6442aa5aba3595eec476f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:15.974859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:16.076786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a1d127a4c6442aa5aba3595eec476f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.077635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a1d127a4c6442aa5aba3595eec476f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.093592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a1d127a4c6442aa5aba3595eec476f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.120812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a1d127a4c6442aa5aba3595eec476f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.123409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a1d127a4c6442aa5aba3595eec476f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.147475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 937/1858] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:15 2022] DELETE /identity/v3/users/86a1d127a4c6442aa5aba3595eec476f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:16.713899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:16.715532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:16.737651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a150f-2624-4602-96f6-51c891a72bf6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:16.749984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:16.870009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:16.870717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:16.871019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:16.871315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] PATH_INFO: `/v3/users/d9d4c256278940479ab02045297ae420` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:16.873517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d4c256278940479ab02045297ae420)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:16.876634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:16.984695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d4c256278940479ab02045297ae420'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:16.988221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:16.991022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.025074 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d4c256278940479ab02045297ae420'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.028384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c1df4-4eb2-4279-8f3d-56e0cfb0de41 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.033549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.034202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.034483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.034758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] PATH_INFO: `/v3/users/95de5a229cc04562a96e81fc9a81d96a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.035930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95de5a229cc04562a96e81fc9a81d96a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.038057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.047816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d4c256278940479ab02045297ae420'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.048137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d4c256278940479ab02045297ae420'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.048893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a593c974-009b-48cf-b5a4-f4cb5f3dce70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d4c256278940479ab02045297ae420'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.073506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 922/1859] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:16 2022] DELETE /identity/v3/users/d9d4c256278940479ab02045297ae420 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:17.076093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.076895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.077507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.111861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:17.114383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.122426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95de5a229cc04562a96e81fc9a81d96a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.123250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95de5a229cc04562a96e81fc9a81d96a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.133819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95de5a229cc04562a96e81fc9a81d96a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.154441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95de5a229cc04562a96e81fc9a81d96a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.155490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3368e1c0-b073-469a-b538-1f48a3b09e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95de5a229cc04562a96e81fc9a81d96a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.177821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 938/1860] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:16 2022] DELETE /identity/v3/users/95de5a229cc04562a96e81fc9a81d96a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:17.184340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.184904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.185346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.209394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 923/1861] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:17.219152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:17.220799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.222181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.223718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.267502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:17.291098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:17.332300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 939/1862] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:17.335156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0a35-dfc7-462e-9971-a63d5e5870a3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.346048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.348006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.370221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d86ce-59c8-42bd-ba98-134b6676ff5c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.375512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.376142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.376472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.376772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] PATH_INFO: `/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.377921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b17f2fdb104487f80b48c7e9a9d0dfa)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.380740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.429109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.429750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.430083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.430408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.440624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.442306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.450902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b17f2fdb104487f80b48c7e9a9d0dfa', 'request_id': 'req-0a332fca-ffe3-4427-acd1-b9d77c7f2545'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.454347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 924/1863] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:17.455067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.459140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b17f2fdb104487f80b48c7e9a9d0dfa', 'request_id': 'req-0a332fca-ffe3-4427-acd1-b9d77c7f2545'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.465504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fb98-2d6d-49f5-b753-6408acd1fc68 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.467037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b17f2fdb104487f80b48c7e9a9d0dfa', 'request_id': 'req-0a332fca-ffe3-4427-acd1-b9d77c7f2545'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.485580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] The token cache is being invalidate because project 4b17f2fdb104487f80b48c7e9a9d0dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:17.486165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.487078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a332fca-ffe3-4427-acd1-b9d77c7f2545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:17.492501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 940/1864] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:17 2022] DELETE /identity/v3/projects/4b17f2fdb104487f80b48c7e9a9d0dfa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:17.494326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4984-eaf2-427c-8d05-89b0da67f62a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.494682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4984-eaf2-427c-8d05-89b0da67f62a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.495026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c4984-eaf2-427c-8d05-89b0da67f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.518826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-979c4984-eaf2-427c-8d05-89b0da67f62a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:17.520115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-979c4984-eaf2-427c-8d05-89b0da67f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.534304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.534997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.535359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.535659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.540359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.602944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 941/1865] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:17.610646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c577-4c54-421e-9376-9d7463887038 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.611008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c577-4c54-421e-9376-9d7463887038 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.611356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c577-4c54-421e-9376-9d7463887038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.637509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.638299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e618c577-4c54-421e-9376-9d7463887038 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:17.639040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.640048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e618c577-4c54-421e-9376-9d7463887038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.651076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 925/1866] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:17.651627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 942/1867] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:17.661751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.675594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4abb-75d0-45a0-a14b-ad5ba30f7d66 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.682791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.683571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.683856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.684564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.684838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:17.685200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.687069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.703586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 926/1868] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:17.707998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618c577-4c54-421e-9376-9d7463887038 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.725867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618c577-4c54-421e-9376-9d7463887038 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.735554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.739702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.740494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.741247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.743508 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.746625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.810084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 943/1869] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:17.815209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.841232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:17.849928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:17.854377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9361651-005f-4944-bb69-3778334e44f0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.891851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:17.929801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:17.955503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.956736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.957279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.957737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.959021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.963592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.975982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af4a3-aef8-4a88-ba79-e9c100e3d5f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:17.984004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:17.984943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:17.985313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:17.985493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] PATH_INFO: `/v3/projects/726f9b22598140c5b84325a9dc09e9e3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:17.987640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=726f9b22598140c5b84325a9dc09e9e3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:17.990933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:17.994066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 927/1870] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:17 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:17.998477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.016769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adca95-696a-46d5-b725-ede0ba5a287e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.025979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.028934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.029255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.029525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.030391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.032408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.050576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 928/1871] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:18.051988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.063786 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc530ea-28b8-4edf-87ba-7c19cbfbaed9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.072942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726f9b22598140c5b84325a9dc09e9e3', 'request_id': 'req-bec11e68-ce3c-4f0d-82c4-92a633928cbb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.089090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726f9b22598140c5b84325a9dc09e9e3', 'request_id': 'req-bec11e68-ce3c-4f0d-82c4-92a633928cbb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.098116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726f9b22598140c5b84325a9dc09e9e3', 'request_id': 'req-bec11e68-ce3c-4f0d-82c4-92a633928cbb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.113268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] The token cache is being invalidate because project 726f9b22598140c5b84325a9dc09e9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:18.113562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.114254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.116514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 944/1872] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:17 2022] DELETE /identity/v3/projects/726f9b22598140c5b84325a9dc09e9e3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:18.117748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.119117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.154203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.154874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.155122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.155388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.156031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.157703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.169892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 929/1873] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:18.173823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.187999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.201698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223395-26cc-495b-a6d6-d7c027c2f2f5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.205081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec11e68-ce3c-4f0d-82c4-92a633928cbb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.207824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.208933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.209354 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.209843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] PATH_INFO: `/v3/users/d315d30ed6024b72acd6f693d3163296` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.210091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.211193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.211480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.211756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] PATH_INFO: `/v3/projects/4ed0467fe107468085981930bd195a65` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.211891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d315d30ed6024b72acd6f693d3163296)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.212934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed0467fe107468085981930bd195a65)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.214423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.214872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.287951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd315d30ed6024b72acd6f693d3163296'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.288218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed0467fe107468085981930bd195a65', 'request_id': 'req-eceec952-e94f-4100-89ea-6a7ea50fe7a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.298511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed0467fe107468085981930bd195a65', 'request_id': 'req-eceec952-e94f-4100-89ea-6a7ea50fe7a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.306807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd315d30ed6024b72acd6f693d3163296'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.307905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed0467fe107468085981930bd195a65', 'request_id': 'req-eceec952-e94f-4100-89ea-6a7ea50fe7a2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.323999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:18.328900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] The token cache is being invalidate because project 4ed0467fe107468085981930bd195a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:18.329290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.330310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.334108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 945/1874] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:18 2022] DELETE /identity/v3/projects/4ed0467fe107468085981930bd195a65 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:18.338100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd315d30ed6024b72acd6f693d3163296'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.339028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.339275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd315d30ed6024b72acd6f693d3163296'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.340364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd315d30ed6024b72acd6f693d3163296'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.340994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.368665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 930/1875] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:18 2022] DELETE /identity/v3/users/d315d30ed6024b72acd6f693d3163296 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:18.369742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.373016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.397708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:18.448863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec952-e94f-4100-89ea-6a7ea50fe7a2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.493981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d430-2ade-4775-b8fe-8c3d79ceb280 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.499586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.500499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.500899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.501353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] PATH_INFO: `/v3/users/3885020fdb174da9b91eb6d9d37501e4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.503646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3885020fdb174da9b91eb6d9d37501e4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.506049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.527201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.527876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.528162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.528513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] PATH_INFO: `/v3/projects/5a0e85c5b2984db184f791dcc80d0506/users/a592364bad8042c182624d2467277d0f/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.552268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0e85c5b2984db184f791dcc80d0506, user_id=a592364bad8042c182624d2467277d0f, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.555488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322a11-2106-4e07-ac4a-97d8dec1c7f8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.566432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3885020fdb174da9b91eb6d9d37501e4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.570796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 946/1876] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:18 2022] PUT /identity/v3/projects/5a0e85c5b2984db184f791dcc80d0506/users/a592364bad8042c182624d2467277d0f/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:18.581976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.582417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.582973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.591575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3885020fdb174da9b91eb6d9d37501e4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.614432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3885020fdb174da9b91eb6d9d37501e4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.615783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3885020fdb174da9b91eb6d9d37501e4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.617440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3885020fdb174da9b91eb6d9d37501e4'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:18.622124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] MFA Rules not processed for user `a592364bad8042c182624d2467277d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:18.624183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.638845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 931/1877] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:18 2022] DELETE /identity/v3/users/3885020fdb174da9b91eb6d9d37501e4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:18.715184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 947/1878] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:18.720361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.722894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:18.833821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc913-05dc-4382-9ece-70b04e7fa382 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:18.839851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:18.840496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:18.840829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:18.841076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:18.841768 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:18.843627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:18.873170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 932/1879] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:18 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:18.877301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:18.903626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:18.950853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d486e00-c975-4fa9-ba4d-b8987a155768 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.009914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.010599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.010827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.011039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.011676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.013659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.039055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 948/1880] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:18 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:19.043317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.048711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.050803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.069199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7303d-fd50-474f-8095-67fd0acc7712 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.069470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f647-4889-40f5-b780-d9abcd3b8b60 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.073393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.073393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.073756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.073949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] PATH_INFO: `/v3/projects/947b246ca72445bfab71ecc6058423c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.075170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=947b246ca72445bfab71ecc6058423c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.075283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.075866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.080911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.080911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.084070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.085060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.085060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.123374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 933/1881] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:19.134731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.145211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:19.159849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d8287-75bb-4f12-a305-d0b2a7511cc3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.165296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.166013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.166479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.166767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.167408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.169332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.210433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 934/1882] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:19.213695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.218639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947b246ca72445bfab71ecc6058423c0', 'request_id': 'req-dad80b8a-8f30-406b-b98d-bcc6723d2bba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.222024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.236448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947b246ca72445bfab71ecc6058423c0', 'request_id': 'req-dad80b8a-8f30-406b-b98d-bcc6723d2bba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.245220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220a44-b9a0-4743-a3f4-d518a80cc605 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.253985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947b246ca72445bfab71ecc6058423c0', 'request_id': 'req-dad80b8a-8f30-406b-b98d-bcc6723d2bba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.272262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] The token cache is being invalidate because project 947b246ca72445bfab71ecc6058423c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:19.272872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.273780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.276017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 949/1883] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:19 2022] DELETE /identity/v3/projects/947b246ca72445bfab71ecc6058423c0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:19.276911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.281401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.319345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.320608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.321038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.321317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] PATH_INFO: `/v3/projects/eb57a955437c419d965cd98f0e36793f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.322509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb57a955437c419d965cd98f0e36793f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.324424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.330251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:19.354456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad80b8a-8f30-406b-b98d-bcc6723d2bba admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.360112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.361138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.361535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.361933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] PATH_INFO: `/v3/projects/039766e428854f418f77b97c996fe54b/users/ee7a46909bf44615b7776cde57e542d7/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.379849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039766e428854f418f77b97c996fe54b, user_id=ee7a46909bf44615b7776cde57e542d7, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.382913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb57a955437c419d965cd98f0e36793f', 'request_id': 'req-75417c2d-a9a4-45c3-8da0-08234c256b44'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.384339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600e295-e828-4a89-a751-833b340cd9c6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.392030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb57a955437c419d965cd98f0e36793f', 'request_id': 'req-75417c2d-a9a4-45c3-8da0-08234c256b44'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.399727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb57a955437c419d965cd98f0e36793f', 'request_id': 'req-75417c2d-a9a4-45c3-8da0-08234c256b44'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.400353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 950/1884] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:19 2022] PUT /identity/v3/projects/039766e428854f418f77b97c996fe54b/users/ee7a46909bf44615b7776cde57e542d7/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:19.401775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce17279-ec79-4428-ad06-e4b7edc70582 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.402063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce17279-ec79-4428-ad06-e4b7edc70582 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.402332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce17279-ec79-4428-ad06-e4b7edc70582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.422217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] The token cache is being invalidate because project eb57a955437c419d965cd98f0e36793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:19.422332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.423035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-75417c2d-a9a4-45c3-8da0-08234c256b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.424769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 935/1885] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:19 2022] DELETE /identity/v3/projects/eb57a955437c419d965cd98f0e36793f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:19.426112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.426426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.427131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.428206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6ce17279-ec79-4428-ad06-e4b7edc70582 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.430608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ce17279-ec79-4428-ad06-e4b7edc70582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.462349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] MFA Rules not processed for user `ee7a46909bf44615b7776cde57e542d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.463646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.513128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 951/1886] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.514606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295adb-d0ac-4119-91af-6aea919cc6b1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.514891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295adb-d0ac-4119-91af-6aea919cc6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.515165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295adb-d0ac-4119-91af-6aea919cc6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.544032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-91295adb-d0ac-4119-91af-6aea919cc6b1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.545284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-91295adb-d0ac-4119-91af-6aea919cc6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.559533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 952/1887] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.559533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.559533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.559533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.560017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 936/1888] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.560101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.561526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.576680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f53c74-f734-4a5b-9afc-adbd11c68f2e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.580869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.582263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.587545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.588213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.588493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.588811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] PATH_INFO: `/v3/users/431f1cdc5f7542709dcfe38a6674a144` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.589953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431f1cdc5f7542709dcfe38a6674a144)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.591940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.598558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 953/1889] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.599465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.601396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.602854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:19.619178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c1f5e-8704-41d8-8b0e-1a9268e832e6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.624458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.625372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.625688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.626108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.626858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.629248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33528f7b-83b3-453a-a898-700ace837dfb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.649313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431f1cdc5f7542709dcfe38a6674a144'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.657096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431f1cdc5f7542709dcfe38a6674a144'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.659102 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 954/1890] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:19.660314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.660660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.660930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.669762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431f1cdc5f7542709dcfe38a6674a144'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.670486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431f1cdc5f7542709dcfe38a6674a144'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.671114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431f1cdc5f7542709dcfe38a6674a144'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:19.681900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.683221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.685806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 937/1891] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:19 2022] DELETE /identity/v3/users/431f1cdc5f7542709dcfe38a6674a144 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:19.689169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.689169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.747146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 955/1892] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.748010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.750001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.757633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba830d6c-1021-4c77-9921-d89e7cb3b401 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.762814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.763433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.763612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05814f-0ada-430b-ab91-fa53a3ec4a80 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.763837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.764117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.764790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:19.765221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.766820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500cca8-60fd-4f02-afda-32808c139afb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.770921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.771582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.771859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.772129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.773600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.775628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.780501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 938/1893] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:19.785552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.785840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.786107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.807446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 956/1894] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/users => generated 295 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:19.807446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.813376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:19.814577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.815971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04f75-b23c-4c8a-a983-aaa0bfaf23e5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.821733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.822321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.822593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.822863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.823503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:19.823808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.826419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.828544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 939/1895] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:19.829361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.844622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:19.848183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1b245-2459-426b-9081-1228272ab4e8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.856442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 957/1896] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:19.857484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.859597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.860473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.860989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.861431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.862254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.864869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.873789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e78d67-a5d4-4086-83a9-891b7132aa89 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.879285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:19.879577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:19.879896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:19.880312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:19.881126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:19.883614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:19.902975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 958/1897] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:19.907189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.909582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:19.912702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 940/1898] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:19.914548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:19.981039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04722b5-9129-45d3-96cd-ec4dcbd4fdc5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:19.996606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.032160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfeb86-6d6c-4694-bade-3b81ec64826f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.039826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.041371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.041371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.041371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.041788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.043681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.051575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.052203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.052466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.052771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.063297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.065155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.075359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 941/1899] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:19 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:20.076141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.076746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 959/1900] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:20.077436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.087159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89febf0f-1099-46d9-8d14-3dce69220ef3 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.159911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41be37-a1a1-49d6-8912-491d935221fa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.161303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.161924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.162200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.162467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.163093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.165545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.167696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.168771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.169232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.169646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] PATH_INFO: `/v3/projects/0e31fde9c1a04874a6996521f3fff27a/users/539791529d0f4402bfd3e3aacf0e23b7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.190557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e31fde9c1a04874a6996521f3fff27a, user_id=539791529d0f4402bfd3e3aacf0e23b7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.192663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 960/1901] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:20 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:20.193429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.193761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.208294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521220e2-2263-402f-908c-a7ca89c39fed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.216724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 942/1902] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:20 2022] PUT /identity/v3/projects/0e31fde9c1a04874a6996521f3fff27a/users/539791529d0f4402bfd3e3aacf0e23b7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.217566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.252918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.284809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.285424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.285704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.285975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.287401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.290732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.307040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275232c-0335-46ec-b381-39352ef3d7ad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.314383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.315217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 961/1903] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:20 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:20.315329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.315728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.316117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.316884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.318299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.319036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.328951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11269f1-db1a-443e-a63b-09d6c62540b4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.331889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 943/1904] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:20.332826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.334036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.334955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.335432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.335772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.336755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.338600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.346367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881356-d9b0-4522-8636-5a3c1a50e3f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.350214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 962/1905] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:20.351839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.354843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.355591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.355894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.356152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.356844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.358746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.364835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82552284-e6b2-4b10-93d4-8c45cc15e8f3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.371299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.371959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.372215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.372487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.373179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.373348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 944/1906] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:20.374000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.374776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.385947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b42d2-8dc6-4823-af1a-190a456be5c9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.391216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 963/1907] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:20.391216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.394041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.394755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.395036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.395306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] PATH_INFO: `/v3/projects/0e31fde9c1a04874a6996521f3fff27a/users/539791529d0f4402bfd3e3aacf0e23b7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.397256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e31fde9c1a04874a6996521f3fff27a, user_id=539791529d0f4402bfd3e3aacf0e23b7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.400028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.401853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e068fef-fd14-47d1-95c8-440bca2ace2d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.407833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.408555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.408899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.409173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.409811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.411398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.414613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 945/1908] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:20 2022] PUT /identity/v3/projects/0e31fde9c1a04874a6996521f3fff27a/users/539791529d0f4402bfd3e3aacf0e23b7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.415703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.417481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.436775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 964/1909] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:20.436775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.446702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa77a1-ac7d-422c-ab5c-5531a0cb3601 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.451846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.485654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469844-53e2-4463-948b-d083a92dca97 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.490715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.491372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.491837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.492121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] PATH_INFO: `/v3/projects/83ab8b4df44344ae89346c4557d14aa1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.493343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ab8b4df44344ae89346c4557d14aa1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.495253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.504748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.505400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.505674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.506105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] PATH_INFO: `/v3/projects/0996f14cf58b44c985625fcca7f6b759/users/29beae707d9043a899a6f5381bd0473f/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.521713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0996f14cf58b44c985625fcca7f6b759, user_id=29beae707d9043a899a6f5381bd0473f, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.525348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11e6d8-2d02-472e-83c6-b0df096c6cee admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.537896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 965/1910] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:20 2022] PUT /identity/v3/projects/0996f14cf58b44c985625fcca7f6b759/users/29beae707d9043a899a6f5381bd0473f/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.538992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec862-df41-4cff-9b32-6fdf3b2eb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.539205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec862-df41-4cff-9b32-6fdf3b2eb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.539452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aec862-df41-4cff-9b32-6fdf3b2eb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.543391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ab8b4df44344ae89346c4557d14aa1', 'request_id': 'req-1b2d234d-fe64-48fe-822f-961afe2e9184'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.552302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ab8b4df44344ae89346c4557d14aa1', 'request_id': 'req-1b2d234d-fe64-48fe-822f-961afe2e9184'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.559978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ab8b4df44344ae89346c4557d14aa1', 'request_id': 'req-1b2d234d-fe64-48fe-822f-961afe2e9184'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.568516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-45aec862-df41-4cff-9b32-6fdf3b2eb1e1 None None] MFA Rules not processed for user `539791529d0f4402bfd3e3aacf0e23b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:20.570303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-45aec862-df41-4cff-9b32-6fdf3b2eb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.571880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] The token cache is being invalidate because project 83ab8b4df44344ae89346c4557d14aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:20.572172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.572850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.574369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 946/1911] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:20 2022] DELETE /identity/v3/projects/83ab8b4df44344ae89346c4557d14aa1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.575111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.576533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.642423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.643012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d234d-fe64-48fe-822f-961afe2e9184 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.648820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 966/1912] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:20.648820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.648820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.648820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.677320 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] MFA Rules not processed for user `29beae707d9043a899a6f5381bd0473f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:20.678722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.722829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.723503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.723785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.724062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] PATH_INFO: `/v3/projects/d135c6d6b76148ffa4fee6787d67c78f/users/62dc93eb9aa5487fa1995dd33fc22ad9/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.738640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.744256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d135c6d6b76148ffa4fee6787d67c78f, user_id=62dc93eb9aa5487fa1995dd33fc22ad9, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.747644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.752653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 967/1913] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:20.755739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.755739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.775826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 947/1914] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:20 2022] PUT /identity/v3/projects/d135c6d6b76148ffa4fee6787d67c78f/users/62dc93eb9aa5487fa1995dd33fc22ad9/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.775826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.775826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.777713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b65912-7c9a-462c-b516-d7a38b5fbada None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.839723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df819705-c492-4f68-8f47-8fc1e73bcd0b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:20.843394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.843526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:20.844000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.844154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.844302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.844435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.844620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.844817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] PATH_INFO: `/v3/users/038e2c94e5224249b2ce4396dec6dcf7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.845881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=038e2c94e5224249b2ce4396dec6dcf7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.847942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.902132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038e2c94e5224249b2ce4396dec6dcf7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.902780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038e2c94e5224249b2ce4396dec6dcf7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.910905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038e2c94e5224249b2ce4396dec6dcf7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.918634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:20.920088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54e11a-e405-4733-9875-4d6573a00b1e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:20.926131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038e2c94e5224249b2ce4396dec6dcf7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.926877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038e2c94e5224249b2ce4396dec6dcf7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:20.931791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 948/1915] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:20.933287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:20.933564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:20.933905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:20.946620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 968/1916] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:20 2022] DELETE /identity/v3/users/038e2c94e5224249b2ce4396dec6dcf7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:20.947272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:20.949082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:20.963172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:20.970949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] MFA Rules not processed for user `62dc93eb9aa5487fa1995dd33fc22ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:20.972672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.071606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2963-c424-4b24-9cf4-6ed319dbc8cd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.086560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.087657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.088379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.092025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.102649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.125871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 949/1917] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:21.130638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.132539 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.185504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:21.209387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.212552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.228027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 969/1918] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:21.229285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.230677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.246435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf6ec1-6228-4069-bb1b-8bca0b2c2ce4 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.251848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.252762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.253404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.253404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.261077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.266576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9f39-2313-41cd-a176-b1c1f88a316a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.281621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.282302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.282632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.283209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.283993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.289875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.344815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 950/1919] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:21 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:21.348640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.412867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.415073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.441576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 970/1920] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:21.446290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d051-7c2a-40b4-8f94-a9ab0f9c94b1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.452509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.453287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.453631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.453961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.454951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.456970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.510411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 951/1921] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:21 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:21.517955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.534005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4f1-f7e2-4e4c-a667-e050492a45ad service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.552795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.555662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.555967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.556242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.556940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.562341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.582696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 971/1922] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:21.584671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.600155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cd78-8524-4423-b1bc-8366f6807977 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.607872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.608894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.609470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.609851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] PATH_INFO: `/v3/projects/f41a86d8befc4e198c486f9985e0a2a1/users/e58cb797435f480f9e24e072d7613f12/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.624956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.627148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:21.648695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41a86d8befc4e198c486f9985e0a2a1, user_id=e58cb797435f480f9e24e072d7613f12, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.652487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.688630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c5c3-676d-49d3-a6b9-4c4be4062b5d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.690170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 952/1923] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:21 2022] PUT /identity/v3/projects/f41a86d8befc4e198c486f9985e0a2a1/users/e58cb797435f480f9e24e072d7613f12/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:21.690170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.752781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:21.764760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.765593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.766714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.767069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] PATH_INFO: `/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.768468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4ed0074e8949b689f46d7958e9bf5d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.771837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.817616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7217cb-67d6-40af-aaf7-be7fbdff55bb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.823987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.824870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.825147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.825437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.826815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.828367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.845989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 953/1924] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:21.846865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:21.860857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61716-5fef-4094-a18b-4ed4b5885153 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:21.880000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:21.894888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4ed0074e8949b689f46d7958e9bf5d', 'request_id': 'req-c99e1435-c29d-401c-800a-18a6230d2d00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:21.916351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4ed0074e8949b689f46d7958e9bf5d', 'request_id': 'req-c99e1435-c29d-401c-800a-18a6230d2d00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:21.925214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4ed0074e8949b689f46d7958e9bf5d', 'request_id': 'req-c99e1435-c29d-401c-800a-18a6230d2d00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:21.948548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] The token cache is being invalidate because project 3d4ed0074e8949b689f46d7958e9bf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:21.948867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:21.950169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c99e1435-c29d-401c-800a-18a6230d2d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:21.952624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 972/1925] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:21 2022] DELETE /identity/v3/projects/3d4ed0074e8949b689f46d7958e9bf5d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:21.957659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734f25-6f93-4aa7-b58f-67687329c613 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.958013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734f25-6f93-4aa7-b58f-67687329c613 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.958296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734f25-6f93-4aa7-b58f-67687329c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.959832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:21.961128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.961586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.961870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] PATH_INFO: `/v3/projects/f41a86d8befc4e198c486f9985e0a2a1/users/e58cb797435f480f9e24e072d7613f12/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:21.964552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41a86d8befc4e198c486f9985e0a2a1, user_id=e58cb797435f480f9e24e072d7613f12, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:21.967312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fd7b3-e034-47d5-9c37-d965b4191c97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:21.979676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 954/1926] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:21 2022] PUT /identity/v3/projects/f41a86d8befc4e198c486f9985e0a2a1/users/e58cb797435f480f9e24e072d7613f12/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:21.991110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:21.991763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:21.992245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.009282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d2734f25-6f93-4aa7-b58f-67687329c613 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:22.011144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d2734f25-6f93-4aa7-b58f-67687329c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.061453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] MFA Rules not processed for user `e58cb797435f480f9e24e072d7613f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:22.062836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.152595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 973/1927] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:22.161012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.161522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.162027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.206595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:22.209014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.212285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 955/1928] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:22.226774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.231295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.244636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 974/1929] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:22.250899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.277527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657785c7-fc1c-4d55-b206-8ce9210da1f5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.285793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.287445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.294818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.295517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.296487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:22.296888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.298842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.312800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504155d5-43a2-4340-9164-d01c228b5e0a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.326044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 975/1930] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:22.331101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.331721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.332360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.332670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.332998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.344203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.346031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.347687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695086b-85d6-4a5c-836f-0838ad9e0cdd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.354397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.355111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.355581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.355943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.356742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.357066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 956/1931] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:22.357879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.359213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.359332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.375110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87858-c4ad-467d-ad84-22272d60ed7a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.381046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.381678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.381958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.382403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] PATH_INFO: `/v3/users/412b04765ad44f598dd7b56ba0576f0d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.383799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412b04765ad44f598dd7b56ba0576f0d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.385780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.392422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 976/1932] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:22 2022] POST /identity/v3/projects => generated 401 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:22.396962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.433240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:22.453081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412b04765ad44f598dd7b56ba0576f0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:22.455402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:22.462206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412b04765ad44f598dd7b56ba0576f0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:22.474763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412b04765ad44f598dd7b56ba0576f0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:22.475463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412b04765ad44f598dd7b56ba0576f0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:22.476838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412b04765ad44f598dd7b56ba0576f0d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:22.477645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e9819-c6ed-4484-ab94-9e20c6d6e777 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.482739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.483339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.483620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.483888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.484518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.486471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36e7d-95cf-44e7-a990-1d3461dd6636 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.490141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 957/1933] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:22 2022] DELETE /identity/v3/users/412b04765ad44f598dd7b56ba0576f0d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:22.493597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.493597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.508415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 977/1934] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:22 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:22.512954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.513556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.513556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.535750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:22.535750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.571076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9752-c690-405d-b950-9827f0e456f3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.577245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.577889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.578233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.578443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.580425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.609183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 978/1935] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:22.623866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.627035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.646869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a9c3-fb73-4741-a5da-05cb5722de18 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.653597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.654155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.654434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.654702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.655351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.657111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.672513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 979/1936] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:22.672513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.674193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.680865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.684371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.699601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 958/1937] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:22.700383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.716224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99014-5958-4e8c-b481-f043de82d46e service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.725650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.727716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.728343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.728805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.729634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.731373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.749484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 959/1938] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:22.754033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:22.773551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649ebb-5d61-49d7-a6e8-74d77fe512e7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.780144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.781021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.781349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.781629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] PATH_INFO: `/v3/projects/618c5be5c09f40879e6ecacb96835875/users/7ed900ceb2054032a1fa8c344fe98608/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.791911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8f37-7e9a-40db-9886-c49d859bc93b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:22.795722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:22.796595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.796978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.797329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.808202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.810022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90cd4f-656d-42b0-a466-7474bd4b058d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.816313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618c5be5c09f40879e6ecacb96835875, user_id=7ed900ceb2054032a1fa8c344fe98608, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:22.820679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:22.822838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 980/1939] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:22.840946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 960/1940] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:22 2022] PUT /identity/v3/projects/618c5be5c09f40879e6ecacb96835875/users/7ed900ceb2054032a1fa8c344fe98608/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:22.854269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:22.854566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:22.854844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:22.896241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] MFA Rules not processed for user `7ed900ceb2054032a1fa8c344fe98608`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:22.900898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:22.996049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:23.014082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 981/1941] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:23.019189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.073136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:23.128016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd39e9d-bc7d-4768-affb-5f1d01b7c472 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.134142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.134903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.135395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.135712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.136600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.139103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.213766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 961/1942] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:23 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:23.214993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.227382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0044-df60-453b-8644-6da99ceb0469 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.244318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.254766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:23.376998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dcd0b-00d6-4e15-a11b-c3f44188f414 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.384570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.385326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.385660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.386090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] PATH_INFO: `/v3/projects/296bd88ce3e540a1a3e06672ff1ff58f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.388437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=296bd88ce3e540a1a3e06672ff1ff58f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.391058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.402604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.402604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.402604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.402604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.403216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.404768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.432828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 982/1943] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:23 2022] POST /identity/v3/users => generated 306 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:23.437255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.464985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52fee-929c-4d50-b90e-edbe9014c795 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.505602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296bd88ce3e540a1a3e06672ff1ff58f', 'request_id': 'req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.529069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296bd88ce3e540a1a3e06672ff1ff58f', 'request_id': 'req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.551327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.552040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.552474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.552891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.554042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.556976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.559065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296bd88ce3e540a1a3e06672ff1ff58f', 'request_id': 'req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.570942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 983/1944] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:23.576066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.589052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] The token cache is being invalidate because project 296bd88ce3e540a1a3e06672ff1ff58f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:23.589385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c85a1-200a-4373-9442-562e8d5ce427 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.589843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.590630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.595968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.596939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.597403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.597834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] PATH_INFO: `/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b/users/53c7079279d9462897608d6bb6472ac4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.599335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 962/1945] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:23 2022] DELETE /identity/v3/projects/296bd88ce3e540a1a3e06672ff1ff58f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:23.605013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.606779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:23.625532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665ac8dc231d4c47ba1af27324dc2c7b, user_id=53c7079279d9462897608d6bb6472ac4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.626359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.643410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 984/1946] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:23 2022] PUT /identity/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b/users/53c7079279d9462897608d6bb6472ac4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:23.649125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.651184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f07f2-927e-4de4-b782-ab0a4c4ec23f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.652084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:23.714406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:23.743998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.745008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.745417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.745795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] PATH_INFO: `/v3/users/6faec9c3585045779e7ff731b4daa4e8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.747702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faec9c3585045779e7ff731b4daa4e8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.750217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.812969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:23.833605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c2d8f-6323-4567-bd02-2b80e0034cc6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.855092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.856807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.857519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.858203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.859978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.863490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd984006-4d4d-4290-9511-e6b30f4de197 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.869745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faec9c3585045779e7ff731b4daa4e8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.890446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faec9c3585045779e7ff731b4daa4e8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.894949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 985/1947] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:23.898532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574927-2697-4081-bcca-055806c74aec None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.899697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574927-2697-4081-bcca-055806c74aec None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.901860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574927-2697-4081-bcca-055806c74aec None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.903639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 986/1948] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:26:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:26:23.906338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574927-2697-4081-bcca-055806c74aec None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:23.930037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faec9c3585045779e7ff731b4daa4e8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.931003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faec9c3585045779e7ff731b4daa4e8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.932724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11f51a83-7c5a-4c5e-b9a4-1ba62e4a8601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faec9c3585045779e7ff731b4daa4e8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:23.941641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574927-2697-4081-bcca-055806c74aec None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:23.957612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:23.958444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:23.958830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:23.959232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] PATH_INFO: `/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b/users/53c7079279d9462897608d6bb6472ac4/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:23.962168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 963/1949] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:23 2022] DELETE /identity/v3/users/6faec9c3585045779e7ff731b4daa4e8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:23.963730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=665ac8dc231d4c47ba1af27324dc2c7b, user_id=53c7079279d9462897608d6bb6472ac4, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:23.966720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518aaf5-6b6d-4bf9-b238-d9dbdde37f4a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:23.985901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 987/1950] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:23 2022] PUT /identity/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b/users/53c7079279d9462897608d6bb6472ac4/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:24.000911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.002343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.002627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.009131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.009414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.009688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.083545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] MFA Rules not processed for user `53c7079279d9462897608d6bb6472ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:24.084528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:24.086242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.088357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.239741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 964/1951] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:24.249070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:24.251088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.270120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 988/1952] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:24.387595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:24.402312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074e9df-ccfb-4393-ae04-2a8fb68879f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:24.412751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:24.413976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.414971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.415253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.437897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:24.441301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:24.483486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 965/1953] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:24.620453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:24.622300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.737828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:24.739304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.750823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf955-7ff8-429c-9072-150eef1f7228 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:24.752675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330368ba-d126-414e-87f9-450fd678d84f service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:24.756725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:24.763300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.763300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.763300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.763550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:24.763550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.763550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.763800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] PATH_INFO: `/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.765254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.767037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d17d87dc3447ea94d6d2dd141b6e3c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:24.769628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:24.864114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d17d87dc3447ea94d6d2dd141b6e3c', 'request_id': 'req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:24.872444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d17d87dc3447ea94d6d2dd141b6e3c', 'request_id': 'req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:24.879144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:24.881474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:24.887372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d17d87dc3447ea94d6d2dd141b6e3c', 'request_id': 'req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:24.896006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 966/1954] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:24.904504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:24.909999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:24.911192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:24.927632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] The token cache is being invalidate because project b6d17d87dc3447ea94d6d2dd141b6e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:24.928297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:24.931882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-10c752f3-a9f4-4590-bf5d-49db1bd9a39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:24.935481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 989/1955] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:24 2022] DELETE /identity/v3/projects/b6d17d87dc3447ea94d6d2dd141b6e3c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:24.941993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbef7-c8c9-4e7f-bc9a-770dd81f9364 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:24.942298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbef7-c8c9-4e7f-bc9a-770dd81f9364 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:24.942545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbbef7-c8c9-4e7f-bc9a-770dd81f9364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:24.952720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df128458-e9f6-4abb-82bf-6e5959225e92 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:24.991640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bcdbbef7-c8c9-4e7f-bc9a-770dd81f9364 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:24.999126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bcdbbef7-c8c9-4e7f-bc9a-770dd81f9364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.113667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.114323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.115709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.115709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.121004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.148490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.152932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.177058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 990/1956] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:25.186524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.186837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.187937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.194250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 967/1957] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:25.249315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:25.254315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.279349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 991/1958] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:25.283711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.305862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef1fdf-01c1-41fc-b452-0031f6ae567f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.312557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.313298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.314264 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.315515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.316269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:25.316467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.321652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.354831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.357192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 968/1959] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:25.375086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.379843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.395037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0b24-e0ee-4960-86c3-9bf3c63a721d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.408188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.408499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0e29-cca5-446a-8589-be422482b2a6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.409392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.409880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.410341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.411237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.413484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.422375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.423688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.424289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.424763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] PATH_INFO: `/v3/users/a592364bad8042c182624d2467277d0f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.426687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a592364bad8042c182624d2467277d0f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.437829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.476175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 992/1960] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:25.480341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.582973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a592364bad8042c182624d2467277d0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:25.605131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a592364bad8042c182624d2467277d0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:25.605131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:25.631729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a592364bad8042c182624d2467277d0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:25.632720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a592364bad8042c182624d2467277d0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:25.634321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4d4f22db-9c51-4743-9e79-e47db731b0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a592364bad8042c182624d2467277d0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:25.661252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 969/1961] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:25 2022] DELETE /identity/v3/users/a592364bad8042c182624d2467277d0f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:25.662891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933dda3-5b59-4aa7-9761-54d8004eec20 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.666400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.666757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.667100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.716053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:25.717718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.841582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.842081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.842356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.845804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.846512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.848461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.918607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 993/1963] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:25 2022] POST /identity/v3/users => generated 283 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:25.918980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 970/1963] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:25.919529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.926210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.928062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.929445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.957585 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fefd-030b-43e2-8a64-3ba36fcca820 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.971864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.972661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.972949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.973288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.973957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.977858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.979800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:26.009870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 994/1964] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:26.011256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.034082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915ef-b9d9-4c2d-8ebe-ee2357054b91 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.041345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.042316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.042771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.043114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.043842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.045575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.071745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 995/1965] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:26.074602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.083508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19f2d3-5e2a-4fa8-9766-0635cc959bcc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.091608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.091608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.091608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.091608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.094486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52cdaf-32ce-458c-a356-e1a0116e051f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.114542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.115300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.115838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.116207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] PATH_INFO: `/v3/projects/5da0e8acaaed43648850ef64fcf2759b/users/9a1663530421413498918c3f4b8db7fe/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.125303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.130418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1887bbe-2217-4994-b260-69de9c46db88 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.137966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da0e8acaaed43648850ef64fcf2759b, user_id=9a1663530421413498918c3f4b8db7fe, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.141082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.152600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 971/1966] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:26.194799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 996/1967] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:26 2022] PUT /identity/v3/projects/5da0e8acaaed43648850ef64fcf2759b/users/9a1663530421413498918c3f4b8db7fe/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:26.206344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256007-540b-447c-8a85-3880e89cafca None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.206645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256007-540b-447c-8a85-3880e89cafca None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.206921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02256007-540b-447c-8a85-3880e89cafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.269479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-02256007-540b-447c-8a85-3880e89cafca None None] MFA Rules not processed for user `9a1663530421413498918c3f4b8db7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:26.274923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-02256007-540b-447c-8a85-3880e89cafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.345558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.347514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.392077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 972/1968] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:26.396838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256007-540b-447c-8a85-3880e89cafca None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.407311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:26.490340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fdfb6-dbd5-4acf-8bba-114a0d94d1fa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.497529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.498546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.499104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.500240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] PATH_INFO: `/v3/users/62dc93eb9aa5487fa1995dd33fc22ad9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.502731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dc93eb9aa5487fa1995dd33fc22ad9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.504800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02256007-540b-447c-8a85-3880e89cafca None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.507957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.510291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.511145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.511524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.511746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.512508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.514639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.566607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 973/1969] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:26 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:26.568274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.617861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dc93eb9aa5487fa1995dd33fc22ad9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.618557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dc93eb9aa5487fa1995dd33fc22ad9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.633849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dc93eb9aa5487fa1995dd33fc22ad9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.654714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dc93eb9aa5487fa1995dd33fc22ad9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.655555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dc93eb9aa5487fa1995dd33fc22ad9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.689052 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd8246-0fea-4e2e-9c03-b3d983e660b3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.694690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 997/1970] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:26 2022] DELETE /identity/v3/users/62dc93eb9aa5487fa1995dd33fc22ad9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:26.694690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.697045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.769872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:26.785921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.786546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.786830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.787105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.787760 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.791888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649dd24-f64d-44b9-a3d9-ea78ce302de1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.798053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeeeb9-ca60-4081-af44-ab8c31b6c4bd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.806219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.808064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.808349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.809299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] PATH_INFO: `/v3/projects/5a0e85c5b2984db184f791dcc80d0506` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.811064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0e85c5b2984db184f791dcc80d0506)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.813038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.830309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 974/1971] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:26 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:26.831465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.831757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.832055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.857950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:26.859613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.873923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 975/1972] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:26.874878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.877763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.891880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83073b-a307-441b-a97c-5353e85bce0f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:26.899723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:26.900762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:26.901237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:26.901756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:26.902651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:26.904696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:26.917974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 976/1973] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:26.919056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.921474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:26.934396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0e85c5b2984db184f791dcc80d0506', 'request_id': 'req-fb278a0b-19f8-4aea-8460-d4257e2976b9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.941430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0e85c5b2984db184f791dcc80d0506', 'request_id': 'req-fb278a0b-19f8-4aea-8460-d4257e2976b9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.942571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:26.950653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0e85c5b2984db184f791dcc80d0506', 'request_id': 'req-fb278a0b-19f8-4aea-8460-d4257e2976b9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.972481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] The token cache is being invalidate because project 5a0e85c5b2984db184f791dcc80d0506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:26.972811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.973627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:26.978954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 998/1974] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:26 2022] DELETE /identity/v3/projects/5a0e85c5b2984db184f791dcc80d0506 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:26.978954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:26.978954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.006533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b137-fcea-4b22-945c-c4da9ae9c2a7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.074523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb278a0b-19f8-4aea-8460-d4257e2976b9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.079988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.080687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.080970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.081792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] PATH_INFO: `/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7/users/c077630e71e947e98c04681774c27672/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.107404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3252db6f2d4fe592c389ec05ee32e7, user_id=c077630e71e947e98c04681774c27672, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.112950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.115327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.117360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.117360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.117670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.119767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.135425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 999/1975] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:26 2022] PUT /identity/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7/users/c077630e71e947e98c04681774c27672/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:27.136605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.139383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.141336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.141814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.154644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 977/1976] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:27.168817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.192817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e0eb-72e2-4618-bbf1-d2484ff9616b service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.274697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:27.307508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.308362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.308897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.309364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.310521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.312335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.319390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f3da-4d76-4701-b670-14196f637f45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.327125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 978/1977] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:27.331207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.350519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.351208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.353125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70add-7ee7-488f-8a07-b5ecd3778b67 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.354714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.356124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] PATH_INFO: `/v3/users/ee7a46909bf44615b7776cde57e542d7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.359276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7a46909bf44615b7776cde57e542d7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.375854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.380069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.380778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.381061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.381339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] PATH_INFO: `/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7/users/c077630e71e947e98c04681774c27672/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.384119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3252db6f2d4fe592c389ec05ee32e7, user_id=c077630e71e947e98c04681774c27672, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.387922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3146784-87f0-4e8d-a5f1-9028eb6cea90 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.448684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 979/1978] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:27 2022] PUT /identity/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7/users/c077630e71e947e98c04681774c27672/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:27.450207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.450505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.450777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.458614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7a46909bf44615b7776cde57e542d7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:27.459628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7a46909bf44615b7776cde57e542d7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:27.482402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7a46909bf44615b7776cde57e542d7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:27.518594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] MFA Rules not processed for user `c077630e71e947e98c04681774c27672`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:27.519837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.520687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7a46909bf44615b7776cde57e542d7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:27.521589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7a46909bf44615b7776cde57e542d7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:27.558010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1000/1979] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:27 2022] DELETE /identity/v3/users/ee7a46909bf44615b7776cde57e542d7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:27.589722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:27.634785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 980/1980] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:27.646288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.647826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.736387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a03b-8e1f-4f68-bda8-b9194def808f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.740847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.741610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.742570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.742877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.832242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.834744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.861038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1001/1981] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:27.940901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.942522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.973331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.982447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae070a-dd9b-4078-a3a2-997387050703 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.986850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.987436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.987792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.987966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.989994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.016813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:28.114148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.115943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.120395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4355fea-0119-48ed-ac46-072a165e70f0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.142167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1002/1982] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:28.220745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:28.223957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.265779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.268448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.268938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.269944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] PATH_INFO: `/v3/projects/039766e428854f418f77b97c996fe54b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.271402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039766e428854f418f77b97c996fe54b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.274898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.348636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d43a4f-18d5-40e2-bc19-87ed1784a4da service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.377445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039766e428854f418f77b97c996fe54b', 'request_id': 'req-faf33aed-c48e-4e56-a183-3cc0b1b3f905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.394582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039766e428854f418f77b97c996fe54b', 'request_id': 'req-faf33aed-c48e-4e56-a183-3cc0b1b3f905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.416529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039766e428854f418f77b97c996fe54b', 'request_id': 'req-faf33aed-c48e-4e56-a183-3cc0b1b3f905'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] The token cache is being invalidate because project 039766e428854f418f77b97c996fe54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:28.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 981/1983] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:27 2022] DELETE /identity/v3/projects/039766e428854f418f77b97c996fe54b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:28.441847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:28.442516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.465508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:28.475193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.476706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.477092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.477601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] PATH_INFO: `/v3/projects/d135c6d6b76148ffa4fee6787d67c78f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.479368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d135c6d6b76148ffa4fee6787d67c78f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.481901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.548423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf33aed-c48e-4e56-a183-3cc0b1b3f905 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.551026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd135c6d6b76148ffa4fee6787d67c78f', 'request_id': 'req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.561309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd135c6d6b76148ffa4fee6787d67c78f', 'request_id': 'req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.569279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd135c6d6b76148ffa4fee6787d67c78f', 'request_id': 'req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.580496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:28.586740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] The token cache is being invalidate because project d135c6d6b76148ffa4fee6787d67c78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:28.587310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.588816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.590996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1003/1984] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:28 2022] DELETE /identity/v3/projects/d135c6d6b76148ffa4fee6787d67c78f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:28.591914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:28.593253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.620826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.621459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.621744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.622033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] PATH_INFO: `/v3/users/29beae707d9043a899a6f5381bd0473f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.623277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29beae707d9043a899a6f5381bd0473f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.625237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.665336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada097a-6b9b-44bf-b6cb-2a487dc41ac5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.671182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.671815 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.672092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.672385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] PATH_INFO: `/v3/users/539791529d0f4402bfd3e3aacf0e23b7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.673566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539791529d0f4402bfd3e3aacf0e23b7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.675304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29beae707d9043a899a6f5381bd0473f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.675463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.683128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29beae707d9043a899a6f5381bd0473f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.700393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29beae707d9043a899a6f5381bd0473f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.701239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29beae707d9043a899a6f5381bd0473f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.701873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29beae707d9043a899a6f5381bd0473f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.716631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 982/1985] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:28 2022] DELETE /identity/v3/users/29beae707d9043a899a6f5381bd0473f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:28.720532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:28.722070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.731507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539791529d0f4402bfd3e3aacf0e23b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.732218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539791529d0f4402bfd3e3aacf0e23b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.738949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539791529d0f4402bfd3e3aacf0e23b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.752315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539791529d0f4402bfd3e3aacf0e23b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.753083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-333fd0a3-c71a-400e-ae5e-c20f3be1d5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539791529d0f4402bfd3e3aacf0e23b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.767106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1004/1986] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:28 2022] DELETE /identity/v3/users/539791529d0f4402bfd3e3aacf0e23b7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:28.770286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.770286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.770286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.774609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:28.791516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:28.792761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.798201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725339-0f42-45b5-9b37-a0eec2aef522 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.859885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1005/1987] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:28.869806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.870504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.870808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.870950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:28.871078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] PATH_INFO: `/v3/users/e58cb797435f480f9e24e072d7613f12` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.872277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58cb797435f480f9e24e072d7613f12)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.873297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:28.874542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.898453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:28.932450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58cb797435f480f9e24e072d7613f12'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.940771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58cb797435f480f9e24e072d7613f12'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.945458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab849-531b-4093-84ef-4cf1eef137e3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:28.957054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:28.957802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:28.958125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:28.958342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:28.961623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58cb797435f480f9e24e072d7613f12'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.962529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58cb797435f480f9e24e072d7613f12'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.963164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58cb797435f480f9e24e072d7613f12'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:28.969851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:28.971546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:28.978286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 983/1988] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:28 2022] DELETE /identity/v3/users/e58cb797435f480f9e24e072d7613f12 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:28.988987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1006/1989] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:29.289201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:29.291272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.378328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220cba8-4043-43f6-b3b6-05392ee4b6df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:29.383847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:29.384484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.384793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.385066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] PATH_INFO: `/v3/projects/f41a86d8befc4e198c486f9985e0a2a1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.386212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41a86d8befc4e198c486f9985e0a2a1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:29.388186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:29.402448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:29.461939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:29.463934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.466210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41a86d8befc4e198c486f9985e0a2a1', 'request_id': 'req-b50818a2-9d15-42b6-acf4-399964ced3f9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.478157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41a86d8befc4e198c486f9985e0a2a1', 'request_id': 'req-b50818a2-9d15-42b6-acf4-399964ced3f9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.481103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d238-6c68-48e3-843b-f13c83df8afd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:29.489619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41a86d8befc4e198c486f9985e0a2a1', 'request_id': 'req-b50818a2-9d15-42b6-acf4-399964ced3f9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.505323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] The token cache is being invalidate because project f41a86d8befc4e198c486f9985e0a2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:29.505851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.506712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b50818a2-9d15-42b6-acf4-399964ced3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.513443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 984/1990] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:29 2022] DELETE /identity/v3/projects/f41a86d8befc4e198c486f9985e0a2a1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:29.515357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe737c4-a817-4565-b61f-b6faa3c4d165 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.515866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe737c4-a817-4565-b61f-b6faa3c4d165 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.516198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe737c4-a817-4565-b61f-b6faa3c4d165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.540297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fbe737c4-a817-4565-b61f-b6faa3c4d165 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:29.541676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fbe737c4-a817-4565-b61f-b6faa3c4d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.586583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:29.586583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.586583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.586583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] PATH_INFO: `/v3/projects/0e31fde9c1a04874a6996521f3fff27a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.593020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e31fde9c1a04874a6996521f3fff27a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:29.600177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:29.685042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 985/1991] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:29.693068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238df3-6e3d-4209-a123-42427b362201 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.693632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238df3-6e3d-4209-a123-42427b362201 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.694223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238df3-6e3d-4209-a123-42427b362201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.731336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e31fde9c1a04874a6996521f3fff27a', 'request_id': 'req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.740341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-13238df3-6e3d-4209-a123-42427b362201 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:29.743169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e31fde9c1a04874a6996521f3fff27a', 'request_id': 'req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.743553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-13238df3-6e3d-4209-a123-42427b362201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.758372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e31fde9c1a04874a6996521f3fff27a', 'request_id': 'req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.780829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] The token cache is being invalidate because project 0e31fde9c1a04874a6996521f3fff27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:29.781020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.782640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9c5586ed-5ce5-4df8-8f4c-e43891d1ab75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:29.792008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1007/1992] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:29 2022] DELETE /identity/v3/projects/0e31fde9c1a04874a6996521f3fff27a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:29.793584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.793873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.794156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.830606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:29.836517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.924951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:29.961883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1008/1993] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:29.961883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:29.962165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 986/1994] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:29.962257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:29.962342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.962342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.962342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.973219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9f0e8-cb0e-4719-a4c5-a52025db3046 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:29.979330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:29.979986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:29.980347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:29.980645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] PATH_INFO: `/v3/projects/0996f14cf58b44c985625fcca7f6b759` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:29.981811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0996f14cf58b44c985625fcca7f6b759)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:29.983990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.001477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:30.003012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.013213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 987/1995] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:30.014087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.027677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0c8e1-33f0-47c3-8c89-b2b6ad13bb55 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.036332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.037270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.037785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.038143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.039517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:30.039922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.041877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.055040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0996f14cf58b44c985625fcca7f6b759', 'request_id': 'req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.060544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 988/1996] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:30.060544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.060544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.073022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0996f14cf58b44c985625fcca7f6b759', 'request_id': 'req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.074398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2677b-6d00-4f72-92c8-cf3c6c52ade0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.080948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0996f14cf58b44c985625fcca7f6b759', 'request_id': 'req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.098287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] The token cache is being invalidate because project 0996f14cf58b44c985625fcca7f6b759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:30.098932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.099476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:30.100213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.104721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1009/1997] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:29 2022] DELETE /identity/v3/projects/0996f14cf58b44c985625fcca7f6b759 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:30.106213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.108212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.166834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.167486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.167771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.168083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] PATH_INFO: `/v3/users/7ed900ceb2054032a1fa8c344fe98608` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.169462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed900ceb2054032a1fa8c344fe98608)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.171771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.191251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46230b6a-8fa1-44f3-97f8-cd28cb5518c5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.199586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.201805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.203958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.204470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.205317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:30.205936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.207652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.242523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed900ceb2054032a1fa8c344fe98608'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.246032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1010/1998] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:30.249572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.251358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.251516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed900ceb2054032a1fa8c344fe98608'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.266465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b132-e9aa-4411-b893-d6edbf80ee53 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.267406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed900ceb2054032a1fa8c344fe98608'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.269143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed900ceb2054032a1fa8c344fe98608'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.270021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0e73173e-37c2-4a04-8d4f-adf029b273a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed900ceb2054032a1fa8c344fe98608'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:30.274496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.275309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.275905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.276257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.278072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.280176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.290815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 989/1999] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:30 2022] DELETE /identity/v3/users/7ed900ceb2054032a1fa8c344fe98608 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:30.292259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8788036-2213-44bf-85c0-c5352932701c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.292841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8788036-2213-44bf-85c0-c5352932701c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.293468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8788036-2213-44bf-85c0-c5352932701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.313744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1011/2000] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:30.314841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.317805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c8788036-2213-44bf-85c0-c5352932701c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:30.318079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.319132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c8788036-2213-44bf-85c0-c5352932701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.375718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:30.393425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 990/2001] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:30.399446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.400017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.400606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.410684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4db68-5826-44a1-b9c0-15d6337bee7e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.417313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.417932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.418209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.418485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.419114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.421064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c336bf-6cd7-4538-8813-4890b45fecc2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.421402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:30.424494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.434296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 991/2002] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:30.435236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.438430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.453969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb74c1-3ffd-441f-b2e6-1d6c4051fc0f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.456613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1012/2003] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:30.456613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.456613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.456923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.478319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:30.479696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.498468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:30.534309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.534922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.535198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.535464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.536082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.538033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.555995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1013/2004] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:30.557069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.558451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:30.569398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 992/2005] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/users => generated 281 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:30.571380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.583291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ff95-0d18-4c1b-b3b5-5de77e352597 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.588715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.589368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.589826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.589944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.590614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.592686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.629299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ff32-8117-4761-b964-9eeaf9126d03 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.632801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 993/2006] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:30.632801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.636527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.637987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.637987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.637987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.644343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7000f-b8a1-4a52-a129-d94553119b2b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.648205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.649818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.650291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.650934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.651286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.651631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.652395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:30.652795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.654612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.674108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 994/2007] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:30.674907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.677005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1014/2008] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:30.680231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.690732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c305e-f606-4252-9283-4a6a5d741e23 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.693776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62694-4d7d-4324-a411-52d76156f496 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.697750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.698390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.698644 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.698913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.699563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.701185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.705331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.705926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.706211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.706480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.709297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.711712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.718696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1015/2009] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:30.718696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.727494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 995/2010] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:30.727494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.732850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4318e-ae15-4007-ab20-966521597854 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.736015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37e638-70e2-45f7-abab-672dd87b2a4a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.738581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.739500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.740061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.741017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.742371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.743222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.743911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.744794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.745140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.745793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.745899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.747861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.767646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 996/2011] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:30.768035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.783165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cefd-0748-4da5-8105-0d9dc7587f97 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.787076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1016/2012] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:30.788523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.790481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.791108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.791390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.791667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.792315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.793962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.813084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 997/2013] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:30.813084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.825637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b64ba-069b-49b0-a56d-246bd215f79d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.854902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:30.884395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4cfea-d1ba-4e05-8136-cd7aa0fcdb85 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:30.891515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.892198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.892477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.892852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] PATH_INFO: `/v3/projects/48dabd93b19c435698a6f495db45cc86/users/614356c2f6344dcfb8061f02ea6e6962/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.929820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dabd93b19c435698a6f495db45cc86, user_id=614356c2f6344dcfb8061f02ea6e6962, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.935355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:30.977059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1017/2014] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:30 2022] PUT /identity/v3/projects/48dabd93b19c435698a6f495db45cc86/users/614356c2f6344dcfb8061f02ea6e6962/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:30.977059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:30.992430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:30.993545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:30.993994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:30.994573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:30.995357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:30.998372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98540d-9c0c-457a-be6f-8d7243bfb765 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.061178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 998/2015] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:30 2022] POST /identity/v3/users => generated 282 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:31.062560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43acfa-ed5c-4d1f-9300-caf4eec3729d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.062828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43acfa-ed5c-4d1f-9300-caf4eec3729d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.063104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43acfa-ed5c-4d1f-9300-caf4eec3729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.082323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272c0a-a4cf-4d1d-9657-a5d9a53f041c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.089287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.090075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.090555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.090841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] PATH_INFO: `/v3/projects/e3cd5909a9f54708b77b53592afce7ea/users/3293c3eca68141c2a32bd7dddeaddce8/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.108625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cd5909a9f54708b77b53592afce7ea, user_id=3293c3eca68141c2a32bd7dddeaddce8, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.111885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.138939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1018/2016] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:30 2022] PUT /identity/v3/projects/e3cd5909a9f54708b77b53592afce7ea/users/3293c3eca68141c2a32bd7dddeaddce8/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:31.149141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.183396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9f43acfa-ed5c-4d1f-9300-caf4eec3729d None None] MFA Rules not processed for user `614356c2f6344dcfb8061f02ea6e6962`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:31.184808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f43acfa-ed5c-4d1f-9300-caf4eec3729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.248754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.287004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 999/2017] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:31.289816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.290113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.290389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.321695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a170272-2a8e-4630-bcda-521b55fc8661 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.333639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.334249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.334537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.334783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.335947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.337926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.343191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] MFA Rules not processed for user `3293c3eca68141c2a32bd7dddeaddce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:31.344424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.358978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1019/2018] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:31.360308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.362563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.383630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513139-afb1-4427-8dde-3d7641d062a1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.390994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.391630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.391915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.392188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] PATH_INFO: `/v3/projects/618c5be5c09f40879e6ecacb96835875` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.395568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618c5be5c09f40879e6ecacb96835875)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.398362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.437295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1000/2019] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:31.438176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.453792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41771-1896-4a22-be60-3a886f6e2a5e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.461944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.482771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618c5be5c09f40879e6ecacb96835875', 'request_id': 'req-7d76d628-deb9-41b0-a91d-62a3f4382682'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.492941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618c5be5c09f40879e6ecacb96835875', 'request_id': 'req-7d76d628-deb9-41b0-a91d-62a3f4382682'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.500109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618c5be5c09f40879e6ecacb96835875', 'request_id': 'req-7d76d628-deb9-41b0-a91d-62a3f4382682'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.518598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] The token cache is being invalidate because project 618c5be5c09f40879e6ecacb96835875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:31.518598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.520218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.521858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1020/2020] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:31 2022] DELETE /identity/v3/projects/618c5be5c09f40879e6ecacb96835875 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:31.522862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.524751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.541190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.542188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.542474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.542748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.543383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.546249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.587549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1001/2021] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:31.588530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.590296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.613216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76d628-deb9-41b0-a91d-62a3f4382682 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.665853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.680802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.681555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.681868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.682160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.682895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.684612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.685237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a1ce-87c1-4cb2-be65-6f795695da6e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.691392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.692297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.692807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.693084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.693856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.695941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.700931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1021/2022] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:31.704280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.706116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.721758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60792-00fa-4521-b505-3cfcc1a97a64 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.727990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.728666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.728951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.729229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] PATH_INFO: `/v3/users/53c7079279d9462897608d6bb6472ac4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.730501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c7079279d9462897608d6bb6472ac4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.730895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1002/2023] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:31.731709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.732647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.733505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.793317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c7079279d9462897608d6bb6472ac4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.794075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c7079279d9462897608d6bb6472ac4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.801541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c7079279d9462897608d6bb6472ac4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.811342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.812842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01946e0-8af6-40d6-86d8-45377d27d774 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.818171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.818846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.818973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c7079279d9462897608d6bb6472ac4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.819059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.819300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.820295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c7079279d9462897608d6bb6472ac4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:31.820697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.822466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.841373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1022/2024] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:31 2022] DELETE /identity/v3/users/53c7079279d9462897608d6bb6472ac4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:31.844976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.845877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1003/2025] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:31.846727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:31.849271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.855985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:31.874462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37c32-6500-43f6-a0a4-e288c6ee3ef5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.948628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace120-8993-49a1-96f9-8db431ef49fc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:31.954167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.955500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.956462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.956846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] PATH_INFO: `/v3/projects/ea8fb8614027430fbd6c67736c54bf96/users/6680f5a67b0140eda7b5653736e82ed5/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.957265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:31.958313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:31.958979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:31.959413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:31.961070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.963499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.989891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8fb8614027430fbd6c67736c54bf96, user_id=6680f5a67b0140eda7b5653736e82ed5, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:31.993787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:31.998351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1004/2026] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:31 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:32.000235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.003014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.019182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ac4c4-cab4-4eab-9db4-2a43de3ef73b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.019711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1023/2027] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:31 2022] PUT /identity/v3/projects/ea8fb8614027430fbd6c67736c54bf96/users/6680f5a67b0140eda7b5653736e82ed5/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:32.020802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.105780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:32.115370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb559abc-b5f8-4209-ade7-b014a14f54e4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.115793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.116642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.116917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.117283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.126752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.126918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.127036 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39588fe8-6211-422d-a0b7-d2ffb8f2c95f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.127114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.127114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.127114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.127114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.127114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.135775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1005/2028] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:32.137046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1024/2029] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:32.137479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.138209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.138563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.141516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.153533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e1f2-e2f6-4a7a-8547-b4498e100394 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.159855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.160960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.162210 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.162678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] PATH_INFO: `/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c/users/0ae6b24ef9e44000b2e145d157f7819f/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.171596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] MFA Rules not processed for user `6680f5a67b0140eda7b5653736e82ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:32.173157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.182536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e9abc861a04bf8aba3edbff7e8cb1c, user_id=0ae6b24ef9e44000b2e145d157f7819f, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.185514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.234905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1025/2030] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:32 2022] PUT /identity/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c/users/0ae6b24ef9e44000b2e145d157f7819f/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:32.237391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.349794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:32.350159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1006/2031] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:32.351451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.352648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.385489 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaccda-bdfb-47ca-9941-19d0aff4597b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.421061 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3ff2a-fbaf-486d-9be7-3b08a799ec25 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.425937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.426526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.426805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.427223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] PATH_INFO: `/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab/users/f04d5022aae8495bb91863a0baf5c87d/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.446781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdffd40e74488a966a8d7ad8e206ab, user_id=f04d5022aae8495bb91863a0baf5c87d, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.450635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.464014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.464709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.464993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.465277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] PATH_INFO: `/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.466456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665ac8dc231d4c47ba1af27324dc2c7b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.468411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.469090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1026/2032] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:32 2022] PUT /identity/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab/users/f04d5022aae8495bb91863a0baf5c87d/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:32.470221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.528602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665ac8dc231d4c47ba1af27324dc2c7b', 'request_id': 'req-38dda5fd-e118-439b-a17a-e410414088a8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:32.537607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665ac8dc231d4c47ba1af27324dc2c7b', 'request_id': 'req-38dda5fd-e118-439b-a17a-e410414088a8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:32.548441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665ac8dc231d4c47ba1af27324dc2c7b', 'request_id': 'req-38dda5fd-e118-439b-a17a-e410414088a8'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:32.549673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617bb57-9010-49df-8f26-db01a676b014 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.563506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] The token cache is being invalidate because project 665ac8dc231d4c47ba1af27324dc2c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:32.564157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:32.565516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:32.567630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1007/2033] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:32 2022] DELETE /identity/v3/projects/665ac8dc231d4c47ba1af27324dc2c7b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:32.568825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.571179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.590291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:32.625017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.625614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.626414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.626777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.627528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.630026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.651676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1027/2034] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:32.653640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.658535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.658670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda5fd-e118-439b-a17a-e410414088a8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.662639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.663344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.663805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.664105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.666379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.674984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac410-d6af-4270-85da-c9c4b7b91ea7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.682802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.683543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.683916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.692757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.697392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.703954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f022a7-1313-441f-a066-008d84392637 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.729533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1028/2035] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:32.733942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.734231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.734509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.739652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.742619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.759676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1008/2036] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:32.760561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.762507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.786231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74810-9a98-453f-a85e-8a3d48402b44 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.790279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:32.792040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.795280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.795964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.796299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.796651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] PATH_INFO: `/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c/users/0ae6b24ef9e44000b2e145d157f7819f/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.798770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e9abc861a04bf8aba3edbff7e8cb1c, user_id=0ae6b24ef9e44000b2e145d157f7819f, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.801567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae76c0-cb10-43df-907b-8b9cd21bc9f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.812193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1029/2037] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:32.813280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.832625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1009/2038] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:32 2022] PUT /identity/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c/users/0ae6b24ef9e44000b2e145d157f7819f/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:32.832938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f72bf-bb71-4674-be22-418fc684470c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.833022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b6d6d-78f5-44a5-a597-6668fcd086d2 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.833022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b6d6d-78f5-44a5-a597-6668fcd086d2 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.833022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b6d6d-78f5-44a5-a597-6668fcd086d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.875743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f75b6d6d-78f5-44a5-a597-6668fcd086d2 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:32.877773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f75b6d6d-78f5-44a5-a597-6668fcd086d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.916137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:32.938406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.939451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.939713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.939982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] PATH_INFO: `/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab/users/f04d5022aae8495bb91863a0baf5c87d/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.942820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bdffd40e74488a966a8d7ad8e206ab, user_id=f04d5022aae8495bb91863a0baf5c87d, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.945948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6d7a7-40cd-47bf-b7cc-c60d92a4d5ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.958349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1030/2039] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:32 2022] PUT /identity/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab/users/f04d5022aae8495bb91863a0baf5c87d/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:32.959733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.960542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.960988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.969180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1010/2040] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:32.970478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.970790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.971214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.003777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] MFA Rules not processed for user `0ae6b24ef9e44000b2e145d157f7819f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:33.005207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.006463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] MFA Rules not processed for user `f04d5022aae8495bb91863a0baf5c87d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:33.008293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.066016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:33.089844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1031/2041] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:33.091467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.105137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1011/2042] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:33.108099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.110459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.173597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e896-c89c-4a49-8278-5c88bfe6289b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.180895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.181930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.182836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.183208 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.184139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:33.184439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.186040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4315b0f-2dbc-4d4e-8ffa-5bbc132bf75e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.187439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.190146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.190709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.190987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.191260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.206933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1032/2043] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:33.208196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.212889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.214454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.219543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecd4f7-e458-4dc3-a6d0-5646a63ba32b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.224126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.224748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.225040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.225175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1012/2044] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:33.225374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.226397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.236066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.237447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93f9f-bed9-4c2a-8718-146d8d984bbc service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.237563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.243080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.243684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.243963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.244235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.244899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.246799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.249938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1033/2045] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:33.284537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1013/2046] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:33 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:33.288960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.300680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c0d76-91d4-4bac-81e8-5c1f459f3fcc service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.339594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.389511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:33.418885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.419521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.420343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.420716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.421412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.424164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.442001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4cd5-3ff6-404e-8794-c16f70e23b3c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.453825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.455959 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.456254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.456528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.458000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1034/2047] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:33 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:33.459439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.463810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.478110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8421bf7-20b8-48b2-bef8-2627ff1c7b78 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.482520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.483350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.483840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.484224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.486150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.532214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.534162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.547757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1014/2048] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:33.550184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.562067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.564159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.567406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59077-ad76-4549-bee8-545b240a76ca service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.574541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.575625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.576012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.577104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.578077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.579978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.589532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1035/2049] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:33.597846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1015/2050] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:33.600404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.626556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33e56-3499-4a09-a4d9-1b230326ba5c service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.633120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.633853 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.634158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.634437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.635090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.640014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da148279-1c1f-4479-98e7-0cdb84e1d3e7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.654300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1036/2051] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:33.659018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:33.666687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:33.672366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222c43-6765-41c2-a955-a16abded673e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:33.684196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:33.685162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.685738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.686570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] PATH_INFO: `/v3/projects/eff02868fb6d4aefa5ccaf9ecaef54e7/users/9037f9d0ae944bdeb9bcedb4e18e0008/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.712127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff02868fb6d4aefa5ccaf9ecaef54e7, user_id=9037f9d0ae944bdeb9bcedb4e18e0008, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:33.716791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:33.738460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1016/2052] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:33 2022] PUT /identity/v3/projects/eff02868fb6d4aefa5ccaf9ecaef54e7/users/9037f9d0ae944bdeb9bcedb4e18e0008/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:33.751453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a335c6-704f-44f9-814c-966014aad92a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:33.751723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a335c6-704f-44f9-814c-966014aad92a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:33.752016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a335c6-704f-44f9-814c-966014aad92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:33.799358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-54a335c6-704f-44f9-814c-966014aad92a None None] MFA Rules not processed for user `9037f9d0ae944bdeb9bcedb4e18e0008`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:33.808460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-54a335c6-704f-44f9-814c-966014aad92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:33.916641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1037/2053] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:33.930337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.059635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b503-9dbe-4cf7-a3b7-cda7a5a14b1c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.065826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.067520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.068236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.069735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.072108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.074225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.141211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1017/2054] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:33 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:34.143167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a335c6-704f-44f9-814c-966014aad92a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.159035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a335c6-704f-44f9-814c-966014aad92a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.275948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:34.314055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.314731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.315776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.316065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.316741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.318717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.346800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1038/2055] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:34 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:34.350612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.362295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a973-a569-4e06-9f93-40d2a45e4d93 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.367811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.368651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.368938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.369214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.369858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.371812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.387387 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1018/2056] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:34.392179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.406322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b462-0a8c-4023-bf67-08707a655e6c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.412829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.414150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.414420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.414676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] PATH_INFO: `/v3/projects/1264685125cd44fc9da4999be57bf574/users/07ebbb76dab24ebe8dd3f20aa5f5f268/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.432399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1264685125cd44fc9da4999be57bf574, user_id=07ebbb76dab24ebe8dd3f20aa5f5f268, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.436689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.462674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.484317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dee07-7491-4e2d-8ec7-a7be6602c490 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.495378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1039/2057] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:34 2022] PUT /identity/v3/projects/1264685125cd44fc9da4999be57bf574/users/07ebbb76dab24ebe8dd3f20aa5f5f268/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:34.500182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.597527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.598199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.598483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.598759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] PATH_INFO: `/v3/users/614356c2f6344dcfb8061f02ea6e6962` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.600450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614356c2f6344dcfb8061f02ea6e6962)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.603466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.614282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96678a-7ebf-4437-9aa3-6302ca99ce66 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.622311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.623290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.624020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.624473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.625764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.628706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.643876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1040/2058] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:34.648605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.662637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ffce-4c4e-415d-bd26-28db0767b8cf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.672016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:34.675782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.676090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.676394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] PATH_INFO: `/v3/projects/1264685125cd44fc9da4999be57bf574/users/07ebbb76dab24ebe8dd3f20aa5f5f268/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.680913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1264685125cd44fc9da4999be57bf574, user_id=07ebbb76dab24ebe8dd3f20aa5f5f268, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:34.684072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634622-9f94-4b1c-93be-68e41ee74ed1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:34.701989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614356c2f6344dcfb8061f02ea6e6962'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:34.703098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1041/2059] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:34 2022] PUT /identity/v3/projects/1264685125cd44fc9da4999be57bf574/users/07ebbb76dab24ebe8dd3f20aa5f5f268/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:34.716471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.716840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.717176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.723611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614356c2f6344dcfb8061f02ea6e6962'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:34.726296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:34.743058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614356c2f6344dcfb8061f02ea6e6962'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:34.744256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614356c2f6344dcfb8061f02ea6e6962'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:34.746188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-160c3498-3935-4661-b911-4ee7267b35f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614356c2f6344dcfb8061f02ea6e6962'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:34.769677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1019/2060] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:34 2022] DELETE /identity/v3/users/614356c2f6344dcfb8061f02ea6e6962 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:34.774925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:34.775456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:34.776097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:34.789724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] MFA Rules not processed for user `07ebbb76dab24ebe8dd3f20aa5f5f268`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:34.790945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:34.807853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:34.810784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:34.898532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1020/2061] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:34.912664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1042/2062] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:34.918243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.919625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:34.924062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:34.925693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:34.958312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:34.992329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f4496-7346-4e00-9d9b-f8ceaa369823 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:34.995402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae9828-cd6b-4048-b314-365e419897fb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:35.000552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.001227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.002487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.002487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:35.004143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.004771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.005023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.005295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:35.008053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:35.019531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:35.022305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:35.036761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1021/2063] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:35.088825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:35.090333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:35.101571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1043/2064] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:35.763328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:35.764892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:35.779452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e80c-e675-415e-8e0d-a27a1cb7bb20 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:35.787911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.788812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.789160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.789524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] PATH_INFO: `/v3/projects/48dabd93b19c435698a6f495db45cc86` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:35.791003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dabd93b19c435698a6f495db45cc86)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:35.792633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:35.836434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:35.838068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:35.853564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dabd93b19c435698a6f495db45cc86', 'request_id': 'req-56b22701-bdec-4b0c-b7ee-a4505e6ec566'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.854672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6467-0b96-4826-8227-bdd66b74e571 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:35.863939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dabd93b19c435698a6f495db45cc86', 'request_id': 'req-56b22701-bdec-4b0c-b7ee-a4505e6ec566'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.874764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dabd93b19c435698a6f495db45cc86', 'request_id': 'req-56b22701-bdec-4b0c-b7ee-a4505e6ec566'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.887246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:35.892507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] The token cache is being invalidate because project 48dabd93b19c435698a6f495db45cc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:35.893089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.894893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.897306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1022/2065] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:35 2022] DELETE /identity/v3/projects/48dabd93b19c435698a6f495db45cc86 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:35.903017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:35.906776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:35.957087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.971752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.975518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.976235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] PATH_INFO: `/v3/users/9a1663530421413498918c3f4b8db7fe` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:35.979331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1663530421413498918c3f4b8db7fe)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:35.981881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.005072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b22701-bdec-4b0c-b7ee-a4505e6ec566 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:36.011975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:36.012843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.013185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.013551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] PATH_INFO: `/v3/users/0ae6b24ef9e44000b2e145d157f7819f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.014785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae6b24ef9e44000b2e145d157f7819f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.018808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.069227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1663530421413498918c3f4b8db7fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.070821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1663530421413498918c3f4b8db7fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.089628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1663530421413498918c3f4b8db7fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.110409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1663530421413498918c3f4b8db7fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.111209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-80232988-4108-4549-865c-b07bf6901f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1663530421413498918c3f4b8db7fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.112050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae6b24ef9e44000b2e145d157f7819f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.121133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae6b24ef9e44000b2e145d157f7819f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.124788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:36.129680 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1044/2066] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:35 2022] DELETE /identity/v3/users/9a1663530421413498918c3f4b8db7fe => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:36.136023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.136803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.137414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.144462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae6b24ef9e44000b2e145d157f7819f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.145604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae6b24ef9e44000b2e145d157f7819f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.146455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae6b24ef9e44000b2e145d157f7819f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.177947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1023/2067] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:35 2022] DELETE /identity/v3/users/0ae6b24ef9e44000b2e145d157f7819f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:36.182207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:36.189076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.299823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1045/2068] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:36.311050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:36.312476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.406887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde457-dce0-4d65-ab67-a652e8281b72 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:36.417171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:36.417802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.418129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.418423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.430184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.432665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5d26-e770-4fc1-8edb-b3a427a0cd9d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.449519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1024/2069] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:36.548871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:36.553557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.596625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68b201-133b-46b8-80d7-d4421f99b905 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:36.620656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:36.621251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.621587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.621997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] PATH_INFO: `/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.623384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e9abc861a04bf8aba3edbff7e8cb1c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.633585 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.780869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e9abc861a04bf8aba3edbff7e8cb1c', 'request_id': 'req-655b4724-6888-4509-a34a-e06e918811eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.790394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e9abc861a04bf8aba3edbff7e8cb1c', 'request_id': 'req-655b4724-6888-4509-a34a-e06e918811eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.808652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e9abc861a04bf8aba3edbff7e8cb1c', 'request_id': 'req-655b4724-6888-4509-a34a-e06e918811eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.834934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] The token cache is being invalidate because project 92e9abc861a04bf8aba3edbff7e8cb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:36.835423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.840625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-655b4724-6888-4509-a34a-e06e918811eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.847502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1046/2070] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:36 2022] DELETE /identity/v3/projects/92e9abc861a04bf8aba3edbff7e8cb1c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:36.849828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.850326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.850407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.894830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:36.895028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.938034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:37.024282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1025/2071] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:37.033202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.033382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.033661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.073258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:37.075850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.093692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1047/2072] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:37.098151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.111434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bdc7c-a966-4122-94c9-12b06d5f5092 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.133050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.133678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.133956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.134226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.134889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:37.135192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.137033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.156936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.164553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1026/2073] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:37.169236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39031d01-7161-43c5-8f03-73fcd39bb090 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.175087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.176261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.176261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.176494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.177163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.179832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.257976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1048/2074] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:37 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:37.259306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.274768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.276129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6f642-fcff-4f2e-b10a-b15c214e1f58 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.277925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.374624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.377535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.377990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.378333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.379039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.381290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.424659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1027/2075] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:37 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:37.430025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.435456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:37.441104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f509dc9-99b8-4385-b084-e2d6878d1d31 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.444290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe556926-1f8d-49d2-a1c7-c1d0a8091194 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.448671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.449631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.450193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.450836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] PATH_INFO: `/v3/projects/5da0e8acaaed43648850ef64fcf2759b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.453175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da0e8acaaed43648850ef64fcf2759b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.455218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.455888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.456717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.457779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.458166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.459911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.466170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.484471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1028/2076] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:37.492549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.504764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11476b-f6cd-454b-8183-d226eb6b22dd admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.511153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.512067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.512349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.512693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.513811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.515561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.530906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1029/2077] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:37.531794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.540271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da0e8acaaed43648850ef64fcf2759b', 'request_id': 'req-18b609e9-b86e-42a8-b901-2843d1cf2c85'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.542813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050b525-1672-4b0b-b45a-c13c34e0263f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.550634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da0e8acaaed43648850ef64fcf2759b', 'request_id': 'req-18b609e9-b86e-42a8-b901-2843d1cf2c85'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.561263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da0e8acaaed43648850ef64fcf2759b', 'request_id': 'req-18b609e9-b86e-42a8-b901-2843d1cf2c85'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.580420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] The token cache is being invalidate because project 5da0e8acaaed43648850ef64fcf2759b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:37.580767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.581514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.583115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1049/2078] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:37 2022] DELETE /identity/v3/projects/5da0e8acaaed43648850ef64fcf2759b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:37.586968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.597105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.620262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.621199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.621486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.621759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] PATH_INFO: `/v3/projects/96aaad9dca62420b962be6170fdfddcf/users/31c0728181384fa49cfc721d236f6837/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.644868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96aaad9dca62420b962be6170fdfddcf, user_id=31c0728181384fa49cfc721d236f6837, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.648268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbb12c-89b5-4d01-93bc-e99bd6613182 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.672907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:37.672907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1030/2079] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:37 2022] PUT /identity/v3/projects/96aaad9dca62420b962be6170fdfddcf/users/31c0728181384fa49cfc721d236f6837/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:37.681407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b609e9-b86e-42a8-b901-2843d1cf2c85 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.682231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.683065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.683273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.722038 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] MFA Rules not processed for user `31c0728181384fa49cfc721d236f6837`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:37.723391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.745751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.746389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.746675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.747009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] PATH_INFO: `/v3/users/c077630e71e947e98c04681774c27672` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.748170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c077630e71e947e98c04681774c27672)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:37.750227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:37.796612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:37.807803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1031/2080] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:37.810566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c077630e71e947e98c04681774c27672'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.811260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c077630e71e947e98c04681774c27672'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.819375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.820124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c077630e71e947e98c04681774c27672'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.821838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.836095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c077630e71e947e98c04681774c27672'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.836907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c077630e71e947e98c04681774c27672'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:37.857035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1050/2081] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:37 2022] DELETE /identity/v3/users/c077630e71e947e98c04681774c27672 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:37.908717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bcd69-a2af-4824-afdf-9317631c38a1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:37.968875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:37.970483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:37.979611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:37.980663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:37.981145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:37.981585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:37.985333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.070552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54132-b433-45a1-8fa9-0da23705fd4d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.076266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.076851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.077182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.077459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] PATH_INFO: `/v3/users/3293c3eca68141c2a32bd7dddeaddce8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.078710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3293c3eca68141c2a32bd7dddeaddce8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.080726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.083947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.085525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.092524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:38.099689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1032/2082] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:38.121548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.123084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.138690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44f6b-3a84-4dd4-ae52-6390d206a8f0 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.143748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.144469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.144867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.145450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] PATH_INFO: `/v3/users/31c0728181384fa49cfc721d236f6837` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.147140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c0728181384fa49cfc721d236f6837)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.149825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.155219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3293c3eca68141c2a32bd7dddeaddce8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.156312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3293c3eca68141c2a32bd7dddeaddce8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.166704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3293c3eca68141c2a32bd7dddeaddce8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.183655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3293c3eca68141c2a32bd7dddeaddce8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.184696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3293c3eca68141c2a32bd7dddeaddce8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.224664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1051/2083] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:37 2022] DELETE /identity/v3/users/3293c3eca68141c2a32bd7dddeaddce8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:38.225828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.227872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.231888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c0728181384fa49cfc721d236f6837'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.258395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c0728181384fa49cfc721d236f6837'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.287677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c0728181384fa49cfc721d236f6837'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.290117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c0728181384fa49cfc721d236f6837'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.290805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c0728181384fa49cfc721d236f6837'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.298774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:38.325730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1033/2084] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:38 2022] DELETE /identity/v3/users/31c0728181384fa49cfc721d236f6837 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:38.327078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.328519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.345123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353ae9-c3bb-446b-acac-9ab7af8059ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.445101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.445910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.446417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.446783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] PATH_INFO: `/v3/users/9037f9d0ae944bdeb9bcedb4e18e0008` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.448205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9037f9d0ae944bdeb9bcedb4e18e0008)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.451186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.465401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239c307-ebdd-4199-b165-d575c7ae515d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.472133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.472885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.473292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.473684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] PATH_INFO: `/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.475220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3252db6f2d4fe592c389ec05ee32e7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.477617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.543483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9037f9d0ae944bdeb9bcedb4e18e0008'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.544319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9037f9d0ae944bdeb9bcedb4e18e0008'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.546033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3252db6f2d4fe592c389ec05ee32e7', 'request_id': 'req-a43059a2-90e4-4cda-ada6-63861eaf5139'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.555476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9037f9d0ae944bdeb9bcedb4e18e0008'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.558171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3252db6f2d4fe592c389ec05ee32e7', 'request_id': 'req-a43059a2-90e4-4cda-ada6-63861eaf5139'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.565584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3252db6f2d4fe592c389ec05ee32e7', 'request_id': 'req-a43059a2-90e4-4cda-ada6-63861eaf5139'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.571941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9037f9d0ae944bdeb9bcedb4e18e0008'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.572770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-09922128-d8d8-497e-af30-2e9808fbf6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9037f9d0ae944bdeb9bcedb4e18e0008'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.580893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] The token cache is being invalidate because project bd3252db6f2d4fe592c389ec05ee32e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:38.581735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.582027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a43059a2-90e4-4cda-ada6-63861eaf5139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:38.584021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1034/2085] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:38 2022] DELETE /identity/v3/projects/bd3252db6f2d4fe592c389ec05ee32e7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:38.588803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457e40-0cdf-4c3a-bb71-bc8c7412b3ae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.588803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457e40-0cdf-4c3a-bb71-bc8c7412b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.588803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457e40-0cdf-4c3a-bb71-bc8c7412b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.590281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1052/2086] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:38 2022] DELETE /identity/v3/users/9037f9d0ae944bdeb9bcedb4e18e0008 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:38.594616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1ec4-725e-45d0-850c-a0f3baa3051b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.594906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1ec4-725e-45d0-850c-a0f3baa3051b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.595186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1ec4-725e-45d0-850c-a0f3baa3051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.595839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:38.620366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c1fd1ec4-725e-45d0-850c-a0f3baa3051b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:38.621469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1fd1ec4-725e-45d0-850c-a0f3baa3051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.625867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dd457e40-0cdf-4c3a-bb71-bc8c7412b3ae None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:38.627609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd457e40-0cdf-4c3a-bb71-bc8c7412b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.701343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:38.708161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1035/2087] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:38.709586 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.709821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.710639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.721243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1053/2088] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:38.726604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.726893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.727171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.731842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:38.733216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.741898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1036/2089] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:38.742868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.744042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.754236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:38.756082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.765653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1054/2090] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:38.766492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.767838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.815494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677d8b1-8501-4412-a5f8-4888674dd5fd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.819800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.820411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.820716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.820985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.830861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.832611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc68def-e0de-429f-9ddb-682714084e3d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.843146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587af29a-867f-4ed6-99de-0e2ab42566a8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.846143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1037/2091] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:38.846948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.847462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.847566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.847805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.847913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.848070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.848164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.859034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.860321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.872304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1055/2092] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:38.873205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.874515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.875405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:38.876667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:38.884891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1038/2093] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:38.886294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f088b-6d34-4535-a165-52b92d190585 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.889195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.893341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.894107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.894577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.895013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.899608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436c7f5-b605-490e-8ccf-92e2072c8889 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.905323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.906012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.906372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.906709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.907904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:38.907904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.908107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.909284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.910352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:38.921687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1056/2094] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:38.922549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1039/2095] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:26:38.926837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:38.937487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa764-638f-4ead-aaba-911067f44706 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:38.954535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:38.955217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:38.956043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:38.956043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:38.956533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:38.961720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.013477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1057/2096] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:38 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:39.018824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.034078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514196d4-89af-4a2a-96ad-4db9e32a056a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.125198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.125858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.126078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.126340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.127258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.129544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.172074 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1040/2097] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:39 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:39.172905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.204028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc5634-545a-47b4-8129-1d52b7163807 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.210998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.211970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.212402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.213013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.229411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.230973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.248992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1058/2098] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:39.251086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.265945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591bfb0-b122-451a-8f5c-e1ac80d810ad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.283695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.290441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.291282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.291824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.296610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.302848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.310228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:39.335995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.346117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1041/2099] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:39.353305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.358088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:39.363000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f19544-f74d-4e0c-a19e-4d6bfb39d4df admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.371744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.372429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.373004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.373321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] PATH_INFO: `/v3/projects/0505bb51a5f34552815bf84cde708484/users/4a365edcf7534314a77d71b1729b2f23/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.405826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93f3e-1e7b-4a13-808c-f680a09ce25c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.415976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0505bb51a5f34552815bf84cde708484, user_id=4a365edcf7534314a77d71b1729b2f23, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.418489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25189ad-7717-4578-83d6-6395c3770ef7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.420300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.421340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.421869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.422097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] PATH_INFO: `/v3/projects/eff02868fb6d4aefa5ccaf9ecaef54e7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.424492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff02868fb6d4aefa5ccaf9ecaef54e7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.427140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.440074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1059/2100] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:39 2022] PUT /identity/v3/projects/0505bb51a5f34552815bf84cde708484/users/4a365edcf7534314a77d71b1729b2f23/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:39.453430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.453893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.454437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.517474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] MFA Rules not processed for user `4a365edcf7534314a77d71b1729b2f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:39.519858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:39.547711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff02868fb6d4aefa5ccaf9ecaef54e7', 'request_id': 'req-1ba92dd9-d446-448d-ade2-3dd0b61313d0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.573432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff02868fb6d4aefa5ccaf9ecaef54e7', 'request_id': 'req-1ba92dd9-d446-448d-ade2-3dd0b61313d0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.607154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff02868fb6d4aefa5ccaf9ecaef54e7', 'request_id': 'req-1ba92dd9-d446-448d-ade2-3dd0b61313d0'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.633582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] The token cache is being invalidate because project eff02868fb6d4aefa5ccaf9ecaef54e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:39.637341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.638514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.640889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1042/2101] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:39 2022] DELETE /identity/v3/projects/eff02868fb6d4aefa5ccaf9ecaef54e7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:39.645645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.648558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:39.703237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1060/2102] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:39.704245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.707740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:39.756672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:39.762218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92dd9-d446-448d-ade2-3dd0b61313d0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.771196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.773453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.773944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.774386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] PATH_INFO: `/v3/projects/e3cd5909a9f54708b77b53592afce7ea` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.780115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cd5909a9f54708b77b53592afce7ea)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.782572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.848525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50f704-68b2-49b3-9444-c50e5160c11d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.852956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cd5909a9f54708b77b53592afce7ea', 'request_id': 'req-bc1c74ce-9586-4d3c-a486-c8b3d526f294'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.869100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cd5909a9f54708b77b53592afce7ea', 'request_id': 'req-bc1c74ce-9586-4d3c-a486-c8b3d526f294'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.880329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cd5909a9f54708b77b53592afce7ea', 'request_id': 'req-bc1c74ce-9586-4d3c-a486-c8b3d526f294'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.896688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] The token cache is being invalidate because project e3cd5909a9f54708b77b53592afce7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:39.897170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.898668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.900329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1043/2103] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:39 2022] DELETE /identity/v3/projects/e3cd5909a9f54708b77b53592afce7ea => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:39.901660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:39.903790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:39.918908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:39.924260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:39.925503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:39.925941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:39.926367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] PATH_INFO: `/v3/projects/96aaad9dca62420b962be6170fdfddcf` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:39.927922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96aaad9dca62420b962be6170fdfddcf)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:39.930764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:39.979162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c74ce-9586-4d3c-a486-c8b3d526f294 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:39.989368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96aaad9dca62420b962be6170fdfddcf', 'request_id': 'req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:39.998574 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96aaad9dca62420b962be6170fdfddcf', 'request_id': 'req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.006786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96aaad9dca62420b962be6170fdfddcf', 'request_id': 'req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.025230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] The token cache is being invalidate because project 96aaad9dca62420b962be6170fdfddcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:40.025572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.026273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.028285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1061/2104] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:39 2022] DELETE /identity/v3/projects/96aaad9dca62420b962be6170fdfddcf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:40.032435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.034106 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.056215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.056426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.056591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.056851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] PATH_INFO: `/v3/users/07ebbb76dab24ebe8dd3f20aa5f5f268` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.061438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ebbb76dab24ebe8dd3f20aa5f5f268)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.064163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.110217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:40.131728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ebbb76dab24ebe8dd3f20aa5f5f268'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.131931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ebcc8-3c72-43a7-b89e-2e8c06f65059 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.140354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.141011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ebbb76dab24ebe8dd3f20aa5f5f268'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.141366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.141825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.142453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.143466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.145445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d74ad6-1062-49e8-bb0e-b72be96e92eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.156616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ebbb76dab24ebe8dd3f20aa5f5f268'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.157400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ebbb76dab24ebe8dd3f20aa5f5f268'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.158213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ebbb76dab24ebe8dd3f20aa5f5f268'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.177738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1044/2105] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:39 2022] DELETE /identity/v3/users/07ebbb76dab24ebe8dd3f20aa5f5f268 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:40.179345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.182315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.187138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1062/2106] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:40 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:40.191058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959e4-5992-4521-828c-c88a3f533903 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.191350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959e4-5992-4521-828c-c88a3f533903 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.191839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959e4-5992-4521-828c-c88a3f533903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.221423 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-432959e4-5992-4521-828c-c88a3f533903 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:40.223001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-432959e4-5992-4521-828c-c88a3f533903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.265205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:40.345235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78bba8-c96b-4260-a999-48bde860bf4e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.381547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1063/2107] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:40.381547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432959e4-5992-4521-828c-c88a3f533903 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.384098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-432959e4-5992-4521-828c-c88a3f533903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.402317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432959e4-5992-4521-828c-c88a3f533903 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.414203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.415139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.415426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.415702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.416396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.420437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470f49-7253-4052-a8b3-001fa638462c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.432326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.434008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.434669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.434899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] PATH_INFO: `/v3/users/f04d5022aae8495bb91863a0baf5c87d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.436197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04d5022aae8495bb91863a0baf5c87d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.439111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.463180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1064/2108] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:40 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:40.465190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.465572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.466194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.503890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:40.505816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.520126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1065/2109] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:40.520126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.524980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04d5022aae8495bb91863a0baf5c87d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.534120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04d5022aae8495bb91863a0baf5c87d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.534560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37604f9-6338-4120-9e59-fad4f0b968d8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.543331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.544099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.544906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.545335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.546253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.548667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.554214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04d5022aae8495bb91863a0baf5c87d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.555177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04d5022aae8495bb91863a0baf5c87d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.556226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04d5022aae8495bb91863a0baf5c87d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:40.564269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1066/2110] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:40.565555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.569055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.585346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1045/2111] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:40 2022] DELETE /identity/v3/users/f04d5022aae8495bb91863a0baf5c87d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:40.587081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.588640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.603497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74591c69-795b-448a-ba2d-543ddc8c8146 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.771130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1392da-fd82-4e34-8697-91c4ef6fa8ca admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.777300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.777991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.778192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.778474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.778803 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] PATH_INFO: `/v3/projects/203ccec62d904d05a4fd8736ba442bb3/users/72f69a56a5694d16ab992cc5a4299931/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.779295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.779725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.780139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.781226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:40.781673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.783478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.791414 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:40.800650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1067/2112] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:40.801761 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203ccec62d904d05a4fd8736ba442bb3, user_id=72f69a56a5694d16ab992cc5a4299931, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.801975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.805505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:40.806674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:40.825934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d87d-d5e2-47a3-a26a-4e7433f7db50 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:40.846062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1046/2113] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:40 2022] PUT /identity/v3/projects/203ccec62d904d05a4fd8736ba442bb3/users/72f69a56a5694d16ab992cc5a4299931/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:40.851209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:40.895473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:40.939902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:40.940838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:40.941300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:40.941582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] PATH_INFO: `/v3/projects/1264685125cd44fc9da4999be57bf574` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:40.943451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1264685125cd44fc9da4999be57bf574)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:40.945676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.024123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c1ba-711c-4c23-9bc1-39d96669b861 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.043151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1264685125cd44fc9da4999be57bf574', 'request_id': 'req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.057363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1264685125cd44fc9da4999be57bf574', 'request_id': 'req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.071781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1264685125cd44fc9da4999be57bf574', 'request_id': 'req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.098813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] The token cache is being invalidate because project 1264685125cd44fc9da4999be57bf574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:41.099112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.102919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.107113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1068/2114] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:40 2022] DELETE /identity/v3/projects/1264685125cd44fc9da4999be57bf574 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:41.110165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.112626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.130985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.131637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.136103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.138001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.138516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.140373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579ffdb-1fbb-461e-a450-9e12d147ecb5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.175034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1047/2115] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:40 2022] POST /identity/v3/projects => generated 359 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:41.176608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.177150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.177423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.222249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:41.224031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.255328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f88ef2-33b4-4951-b50e-b1b4a2ddef84 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.314989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1048/2116] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:41.314989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.314989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.338655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ded98d-54be-4cad-b695-c8d5e9f5d96a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.348243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.348474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.349126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.349867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.350161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.350265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.350432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.351156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.351713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.351821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.353872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a410c12-3f9d-4532-99fe-c27d10f6103c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.354586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.367600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1069/2117] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:41.368461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.382438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.419681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1049/2118] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:41.427774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981e07-bb73-416d-b1d9-cae5edd2a327 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.430139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.434417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.434958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.435237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.435509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] PATH_INFO: `/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.436758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bdffd40e74488a966a8d7ad8e206ab)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.438083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.438375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.438581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.441620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:41.473015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:41.494225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:41.495664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.508641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bdffd40e74488a966a8d7ad8e206ab', 'request_id': 'req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.517014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bdffd40e74488a966a8d7ad8e206ab', 'request_id': 'req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.525513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bdffd40e74488a966a8d7ad8e206ab', 'request_id': 'req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.546845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] The token cache is being invalidate because project c5bdffd40e74488a966a8d7ad8e206ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:41.547434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.548614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:41.552705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1070/2119] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:41 2022] DELETE /identity/v3/projects/c5bdffd40e74488a966a8d7ad8e206ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:41.553891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.557518 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.603983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1050/2120] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:41.605021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.606283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.619622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbadde-cef8-4e18-9d7a-073d968f1333 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.629011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.629698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.629978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.630246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.630894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.633165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa03699-7bef-4eea-9b0c-d3dc20e0e2c7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.649062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1051/2121] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:41.649062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.649062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.649062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.656687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1210-d686-43a7-9e0a-f8c40ac9b4d2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.664504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.665227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.665512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.665947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] PATH_INFO: `/v3/projects/203ccec62d904d05a4fd8736ba442bb3/users/72f69a56a5694d16ab992cc5a4299931/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.667897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203ccec62d904d05a4fd8736ba442bb3, user_id=72f69a56a5694d16ab992cc5a4299931, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.670010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:41.670628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.671359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.680031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1052/2122] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:41.680886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.688414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1071/2123] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:41 2022] PUT /identity/v3/projects/203ccec62d904d05a4fd8736ba442bb3/users/72f69a56a5694d16ab992cc5a4299931/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:41.691746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70e8e-aa09-4a3a-8fd5-892119ff1ef0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.693916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.767685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.768295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.768647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.768954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.769663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:41.769963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.772167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ffc5e-0e1b-4c8a-8b7e-cd782ccafcdb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.774140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53756e04-7505-40cc-abb5-ddf009fbe385 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.780428 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.781247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.781628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.782002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.782796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.784460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceec54f-6673-4ccc-bdc8-86181af4c087 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.786268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1053/2124] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:41.787947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.789014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.789487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.797697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1072/2125] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:41.799006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.799290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.799635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.813735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:41.815519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.831391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] MFA Rules not processed for user `72f69a56a5694d16ab992cc5a4299931`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:41.835437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1054/2126] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:41.835437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.835752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:41.845619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337ba1-7ef2-4a4a-a409-1c09ec34597d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:41.846623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:41.850976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:41.852342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:41.852706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:41.852907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:41.853640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:41.855527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:41.908833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1055/2127] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:41.908833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.975965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1073/2128] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:41.975965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:41.991114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:42.004375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c44a5-9678-4223-a011-d25ccb80b045 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.015609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.015609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.015609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.015857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea804c1-b5d4-47ad-91bc-a9dc1309a8e4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.016356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.016356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:42.016356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.016356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.016653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.017301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.017301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.017554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] PATH_INFO: `/v3/projects/d122c46e08fe4db8aeb3c193e1db0ef9/users/9e7afc9267c4462a9d10c53b9b70ca2c/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.029984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1074/2129] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:42.030795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.046619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65289fd-01ef-4ec3-afed-831e0cd44fc9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.046839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d122c46e08fe4db8aeb3c193e1db0ef9, user_id=9e7afc9267c4462a9d10c53b9b70ca2c, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.049852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.055007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.055798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.056255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.056550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.057520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.059938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.069825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1056/2130] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:41 2022] PUT /identity/v3/projects/d122c46e08fe4db8aeb3c193e1db0ef9/users/9e7afc9267c4462a9d10c53b9b70ca2c/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:42.071120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.072767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:42.094239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1075/2131] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:42.097991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.108485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb105102-55b7-4f07-96b4-d444ef9beb2a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.138452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f53911-cfd9-4743-8dca-51e128fcb05d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.142196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.142810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.143094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.143371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.178678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.179971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.180133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.180417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.181123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.183108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390020f-794d-44de-8950-593f7dfa90b1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.223849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.225202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1076/2132] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:42.226198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.230000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.230333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.230725 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.237206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1057/2133] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:42.237881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.251582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570972d2-d9fe-418d-89e4-31130202d817 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.267299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] MFA Rules not processed for user `9e7afc9267c4462a9d10c53b9b70ca2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:42.268942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:42.333049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.334717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.335641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.336064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.336767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.338652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.351759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:42.356811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1058/2134] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:42.360867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.378507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2174c-6ae3-44a3-9c94-77d2606b4c05 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.380724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1077/2135] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:42.386240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.398425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.398425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.398425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.398425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.398976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.398976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.400541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410a37f-65d0-43a5-8926-1ca1fbbbf75c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.422604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.423475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.423907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.424373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.425388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.427338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.434175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1059/2136] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/users => generated 288 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:42.437791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.439194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1078/2137] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:42.439930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.441755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:42.450520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:42.451483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf872-63ab-48f6-90fd-152304608685 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.458935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.459721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.460805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.461308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.463181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.465151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.479396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1079/2138] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:42.480832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.494221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9004f-6823-48c6-9dc0-ea1d3d511ff4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.501227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.501968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.502619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.502970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] PATH_INFO: `/v3/projects/30919561024f4edea63417e757affba6/users/4ed5ae286d0545b7a24c393306945f3d/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.521486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d660-6541-4c3c-9fbf-bc54cf7d8198 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.523093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=30919561024f4edea63417e757affba6, user_id=4ed5ae286d0545b7a24c393306945f3d, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.526236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.527284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.528010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.528391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.528791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.545562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.545562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761e833-dd4f-406a-b4a6-88bef795dfe6 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.545733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1080/2139] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:42 2022] PUT /identity/v3/projects/30919561024f4edea63417e757affba6/users/4ed5ae286d0545b7a24c393306945f3d/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:42.545733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.552985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1060/2140] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:42.555296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.555659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.555940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.608504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] MFA Rules not processed for user `4ed5ae286d0545b7a24c393306945f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:42.609865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:42.712809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933acb-64db-4b49-aea4-de50e37fe5be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.719089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.720049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.720503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.720967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.721769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.724261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.737536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1081/2141] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:42.742956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.756755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405faa-f2ad-460e-a428-bb71ae42e7c6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.763753 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.764393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.764842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.765121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] PATH_INFO: `/v3/users/9e7afc9267c4462a9d10c53b9b70ca2c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.766385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7afc9267c4462a9d10c53b9b70ca2c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.768383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.777167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1061/2142] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:42.779485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.809409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f6a25-2e2e-456f-8abe-378d52304ae8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:42.817201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:42.818109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.818513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.818892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] PATH_INFO: `/v3/projects/77f3994124db4926b8f4566ea073941b/users/ea1e9be3400e4c7ba2e744e648233b96/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.857316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f3994124db4926b8f4566ea073941b, user_id=ea1e9be3400e4c7ba2e744e648233b96, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:42.857739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7afc9267c4462a9d10c53b9b70ca2c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:42.860477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7afc9267c4462a9d10c53b9b70ca2c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:42.863410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:42.873167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7afc9267c4462a9d10c53b9b70ca2c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:42.894270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7afc9267c4462a9d10c53b9b70ca2c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:42.895359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e3a91083-b828-4040-a07c-01650647ebc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7afc9267c4462a9d10c53b9b70ca2c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:42.902733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1062/2143] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:42 2022] PUT /identity/v3/projects/77f3994124db4926b8f4566ea073941b/users/ea1e9be3400e4c7ba2e744e648233b96/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:42.911984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:42.915086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:42.923539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1082/2144] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:42 2022] DELETE /identity/v3/users/9e7afc9267c4462a9d10c53b9b70ca2c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:42.930655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049cfb6-6941-42c6-bad8-35bf18982ed8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:42.931550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049cfb6-6941-42c6-bad8-35bf18982ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:42.932075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049cfb6-6941-42c6-bad8-35bf18982ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:42.997813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:43.002544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d049cfb6-6941-42c6-bad8-35bf18982ed8 None None] MFA Rules not processed for user `ea1e9be3400e4c7ba2e744e648233b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:43.002920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d049cfb6-6941-42c6-bad8-35bf18982ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.086268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faaeac-666d-48e1-aa19-68b82c1b7157 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.115974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:43.128222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1083/2145] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:43.132677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.133250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.133532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.156909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.157815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.158363 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.158995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.162133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.165998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:43.167313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.251199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1084/2146] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:43.252311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.253839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.253959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.255610 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.266304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84294b-e55f-4460-9ff9-9cbbd148debb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.267432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1063/2147] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:43.269440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.271248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.271607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.272212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.273265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.273540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.274475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.276056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.315359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1085/2148] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:43 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:43.316855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.383652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197e3-ccbf-4b68-826e-fd9934324db6 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.466332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe503-cf85-44a7-ac2e-e155dfd77cd2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.474174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.474866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.477816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.478177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.480692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.481306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.481590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.481866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.482506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.485295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.513164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.514639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.532801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1064/2149] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:43.537967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1086/2150] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:43 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:43.549500 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.561472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.563541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.587720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a5e67-b457-4e7e-9656-f8ec66262238 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.594281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda3248-b6a7-48cf-b372-87e420ba914a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.602559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.603224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.603507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.603922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] PATH_INFO: `/v3/users/4a365edcf7534314a77d71b1729b2f23` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.607063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a365edcf7534314a77d71b1729b2f23)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.609099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.610781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.613726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.614240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.616304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.617631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.620557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:43.625000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.659625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1065/2151] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:43.665881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.708220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904e7e-05fa-4ef1-b911-4fa081922cb9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.715236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.716012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.716442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.716894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.717645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.719748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.735878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1066/2152] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:43.740520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:43.762216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530924d4-1f02-4678-9a40-8b821552f120 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:43.763378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a365edcf7534314a77d71b1729b2f23'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:43.764295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a365edcf7534314a77d71b1729b2f23'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:43.768895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:43.769481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.770231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.770231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] PATH_INFO: `/v3/projects/1227b9761e8145508af33829387db31f/users/28200283144f48ee970bf8a88cd30470/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.781489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a365edcf7534314a77d71b1729b2f23'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:43.823971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1227b9761e8145508af33829387db31f, user_id=28200283144f48ee970bf8a88cd30470, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:43.827359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9b21-87f0-47fb-86fd-186c6ed0908c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:43.833941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:43.861863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a365edcf7534314a77d71b1729b2f23'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:43.872643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1067/2153] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:43 2022] PUT /identity/v3/projects/1227b9761e8145508af33829387db31f/users/28200283144f48ee970bf8a88cd30470/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:43.875342 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-85cd6736-9964-4f4c-9a4e-715958417808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a365edcf7534314a77d71b1729b2f23'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:43.879681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.880664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.880985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.907573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1087/2154] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:43 2022] DELETE /identity/v3/users/4a365edcf7534314a77d71b1729b2f23 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:43.916273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:43.917860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:43.918304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:43.940042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] MFA Rules not processed for user `28200283144f48ee970bf8a88cd30470`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:43.941531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:43.969693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:43.973619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.050858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1068/2155] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:44.056862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.059385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.096083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1088/2156] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:44.097910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.099784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.123319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06cc8d-acf9-4a64-a5f8-7b6a8c3fde40 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.137690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.138451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.138734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.139723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] PATH_INFO: `/v3/projects/d122c46e08fe4db8aeb3c193e1db0ef9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.140358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d122c46e08fe4db8aeb3c193e1db0ef9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.142757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.183338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6a74a-4bc0-4f97-a786-95b92c11d6a1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.188924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.189556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.189837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.190113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.190745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.192873 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.233806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd122c46e08fe4db8aeb3c193e1db0ef9', 'request_id': 'req-2588051f-5538-444d-a018-ad6551bd30c2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:44.243581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd122c46e08fe4db8aeb3c193e1db0ef9', 'request_id': 'req-2588051f-5538-444d-a018-ad6551bd30c2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:44.248636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1069/2157] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:44.249949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.250906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd122c46e08fe4db8aeb3c193e1db0ef9', 'request_id': 'req-2588051f-5538-444d-a018-ad6551bd30c2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:44.251942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.267536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] The token cache is being invalidate because project d122c46e08fe4db8aeb3c193e1db0ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:44.267821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:44.268846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:44.270604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1089/2158] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:44 2022] DELETE /identity/v3/projects/d122c46e08fe4db8aeb3c193e1db0ef9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:44.271104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.272826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.285430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:44.333646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bbe74-7024-410a-b895-8e0a8f6cda48 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.340715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.341701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.342364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.343002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.349088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.363450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588051f-5538-444d-a018-ad6551bd30c2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.379110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:44.436882 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.437667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.438053 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.438425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.439789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.441326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.445452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.446780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f9cb-1761-4e1a-8d64-043693a6241a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.460424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1070/2159] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:44.463166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fc82-9154-45ea-9992-479bb94209e4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.463166 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fc82-9154-45ea-9992-479bb94209e4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.463400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18fc82-9154-45ea-9992-479bb94209e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.478246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1090/2160] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:44.494165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3a18fc82-9154-45ea-9992-479bb94209e4 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:44.495578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a18fc82-9154-45ea-9992-479bb94209e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.497077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.517292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616f83-6cbc-4d5f-b654-5b2a17c27265 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.518138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1071/2161] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:44.526644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.527520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.527891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.530341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.531026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.531510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.531856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.532765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.534493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.550912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1091/2162] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:44.552232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.574979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e114-c4a7-4734-bdff-8e576c761be7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.581402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:44.583306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:44.588198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.589361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.589638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.589919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] PATH_INFO: `/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3/users/7ce4f07fba8b4e6c995311009e79a872/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.604016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1072/2163] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:44.607535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.611032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8782f65d6c7a4a8e9702b7b633e394b3, user_id=7ce4f07fba8b4e6c995311009e79a872, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.613751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.628678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232c85-798a-4c28-b876-6ea0e89999b1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.633474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1092/2164] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:44 2022] PUT /identity/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3/users/7ce4f07fba8b4e6c995311009e79a872/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:44.637128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.789481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32c1f-c3b8-494b-b33e-5d80b01109d7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.798185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.798491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.798771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.799554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.800374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:44.800710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.802788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.802914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.803313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.803598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.804733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.805129 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.810842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.833124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1073/2165] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:44.838004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.838638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1093/2166] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:44.840217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.859494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f4ef1-0bac-4165-aadf-c0fc7676310f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.865565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:44.872162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.873617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.873994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.874335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.875040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.877148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.889325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78853113-e425-4ef1-a475-532cc04e4462 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:44.905549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:44.906749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:44.907171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:44.913690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] PATH_INFO: `/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3/users/7ce4f07fba8b4e6c995311009e79a872/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:44.919887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8782f65d6c7a4a8e9702b7b633e394b3, user_id=7ce4f07fba8b4e6c995311009e79a872, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:44.930559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:44.954922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1074/2167] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:44.960702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.983819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1094/2168] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:44 2022] PUT /identity/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3/users/7ce4f07fba8b4e6c995311009e79a872/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:44.984757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:44.993455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.108756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138286eb-d5ac-4836-83be-b406c248a0de admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.140312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:45.224479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac77-5fde-4505-91eb-feb2cfd5f82a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.229072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.230589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.231082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.231679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.232800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.235270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1bcc-899f-4d03-8d57-fe1d90132027 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.238149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.238890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.239597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.239597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] PATH_INFO: `/v3/projects/0505bb51a5f34552815bf84cde708484` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.241304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0505bb51a5f34552815bf84cde708484)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.243239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.280385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1075/2169] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:44 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:45.283129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.283695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.284182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.333427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] MFA Rules not processed for user `7ce4f07fba8b4e6c995311009e79a872`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:45.335404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.350334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0505bb51a5f34552815bf84cde708484', 'request_id': 'req-ddbb6ac5-34de-4355-b98a-9a003882d491'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.360689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0505bb51a5f34552815bf84cde708484', 'request_id': 'req-ddbb6ac5-34de-4355-b98a-9a003882d491'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.371191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0505bb51a5f34552815bf84cde708484', 'request_id': 'req-ddbb6ac5-34de-4355-b98a-9a003882d491'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.398482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] The token cache is being invalidate because project 0505bb51a5f34552815bf84cde708484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:45.399511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.400302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.406848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1095/2170] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:44 2022] DELETE /identity/v3/projects/0505bb51a5f34552815bf84cde708484 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:45.406848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:45.409690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.449138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1076/2171] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:45.450181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:45.451801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.557531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb6ac5-34de-4355-b98a-9a003882d491 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.562410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.563031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.563223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8987e-590e-4c9b-9159-3f785b64fbaf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.563370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.563538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.564178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.566435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.574079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.575759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.575759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.575759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] PATH_INFO: `/v3/users/72f69a56a5694d16ab992cc5a4299931` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.576670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f69a56a5694d16ab992cc5a4299931)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.578716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.582133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1096/2172] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:45.582133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:45.582133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.618850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:45.642731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:45.653137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f69a56a5694d16ab992cc5a4299931'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.665199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f69a56a5694d16ab992cc5a4299931'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.678552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300706e-a9b3-460e-ad99-969b92d66920 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.683877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.684228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f69a56a5694d16ab992cc5a4299931'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.685343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f69a56a5694d16ab992cc5a4299931'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.685890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.686166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.686459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.688388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.690231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f69a56a5694d16ab992cc5a4299931'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:45.708189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1077/2173] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:45 2022] DELETE /identity/v3/users/72f69a56a5694d16ab992cc5a4299931 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:45.709483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:45.712089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:45.769159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.771264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.800812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1097/2174] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:45.838562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503aab60-ea45-4a56-a75f-b2910195f713 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.846286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.846286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.846286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.846689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.847353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.849251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae0ad-dd30-46c1-8482-58aeb35b8526 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:45.873631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1078/2175] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:45.878103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:45.896144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcc3cf-0938-4f8a-beb3-5d32aced3d31 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:45.908367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:45.912958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:45.913491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:45.914177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] PATH_INFO: `/v3/projects/a633ac9c7123472f8ae3e6eecabc5fee/users/a3459db6ab3843f89928842ac253a2a7/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:45.953717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a633ac9c7123472f8ae3e6eecabc5fee, user_id=a3459db6ab3843f89928842ac253a2a7, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:45.956388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.010291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1098/2176] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:45 2022] PUT /identity/v3/projects/a633ac9c7123472f8ae3e6eecabc5fee/users/a3459db6ab3843f89928842ac253a2a7/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:46.011268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.011560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.011841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.065740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] MFA Rules not processed for user `a3459db6ab3843f89928842ac253a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:46.066978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.155793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.157399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.239180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1079/2177] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:46.247749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.295466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a499f-9596-4e0d-929a-b36a67c77521 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.325417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.325417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.325417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.325417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] PATH_INFO: `/v3/projects/203ccec62d904d05a4fd8736ba442bb3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.325716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203ccec62d904d05a4fd8736ba442bb3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.325716 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.342332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:46.386161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2f03f-35bf-4bb1-bd5b-d83f7bc5ee83 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.400883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.402184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.402619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.402994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.405396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.407607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.482744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203ccec62d904d05a4fd8736ba442bb3', 'request_id': 'req-0186b285-79b7-4d77-a0cb-bc188fe44521'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:46.484035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:46.494516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1080/2178] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:46.499194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.501190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203ccec62d904d05a4fd8736ba442bb3', 'request_id': 'req-0186b285-79b7-4d77-a0cb-bc188fe44521'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:46.519699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203ccec62d904d05a4fd8736ba442bb3', 'request_id': 'req-0186b285-79b7-4d77-a0cb-bc188fe44521'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:46.543270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] The token cache is being invalidate because project 203ccec62d904d05a4fd8736ba442bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:46.545364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:46.546438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0186b285-79b7-4d77-a0cb-bc188fe44521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:46.550948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1099/2179] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:46 2022] DELETE /identity/v3/projects/203ccec62d904d05a4fd8736ba442bb3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:46.557138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd40be-9477-4deb-9b5c-10fd27b373ac None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.557669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd40be-9477-4deb-9b5c-10fd27b373ac None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.558596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd40be-9477-4deb-9b5c-10fd27b373ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.593437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1bdd40be-9477-4deb-9b5c-10fd27b373ac None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:46.594798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1bdd40be-9477-4deb-9b5c-10fd27b373ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.595481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38904ad0-fd5a-4ca5-94d2-c9e07e95ad7c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.602344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.603097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.603470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.603951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.604769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.607174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.612918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1100/2180] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:46.614368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.614653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.614922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.638091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1081/2181] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:46.641090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:46.642034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.642306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.643930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.651347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1101/2182] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:46.655413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.658186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b1ea2-0eb3-432f-9e81-67daa10df51d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.666662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.667384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.667641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b454726-bacb-4438-829a-2a95dd27d615 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.667770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.668080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.668837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.670510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.672922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.673520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.673800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.674089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.674890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:46.675355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.677177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.688049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1082/2183] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:46.692679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.695946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1102/2184] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:26:46.700453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.709418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e5c1-7e1f-4ce0-92dd-3a9326ddf887 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.715233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760086c-4c4f-4578-ba09-cc2dc3bcf3fc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.716457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.717263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.717863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.718391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.719099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.720842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.720972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.722032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.722430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.722798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.723659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.725769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.761799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1083/2185] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:46.768518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.770744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1103/2186] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:46.775787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.780960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530dfd6-0ab9-4647-891a-ea511f9fbb5b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.854040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b12004-cf7d-49fd-a117-1b4e7183ea28 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.855624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.856550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.856934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.857289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] PATH_INFO: `/v3/projects/ea87c1be573b43f1af61b4ecdf787cdc/users/a10251cc54f64d4bb1e3a36ad4c745cf/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.859651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:46.860334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.860874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.861270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.862750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.864822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.877567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea87c1be573b43f1af61b4ecdf787cdc, user_id=a10251cc54f64d4bb1e3a36ad4c745cf, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:46.880957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921edbe-43bd-40e1-8cdf-ec604a50b8a0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:46.901392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1104/2187] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:46.903954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:46.907626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1084/2188] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:46 2022] PUT /identity/v3/projects/ea87c1be573b43f1af61b4ecdf787cdc/users/a10251cc54f64d4bb1e3a36ad4c745cf/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:46.918806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:46.919094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:46.919375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:46.925124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76158fa-d8d2-4a10-8d5a-52fb1a39858c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:46.951816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] MFA Rules not processed for user `a10251cc54f64d4bb1e3a36ad4c745cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:46.953079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:46.965397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:46.999519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.000216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.000616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.000999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.001904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.003826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.015263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1105/2189] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:47.019609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.034216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6980eb-1146-4c58-873e-e35a2d8c7ede admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.040006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1085/2190] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:47.044179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.044415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.044571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.045278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.046586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.047767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.050580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.056458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa880f25-4b4f-46db-9195-249ba659fd27 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.062024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.062757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.063093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.063277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1106/2191] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:47.063602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.064296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.066498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.067363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.074231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:47.078433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1101f-379c-4187-afba-57a7e6b50c8d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.084658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.086371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.086810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.089698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] PATH_INFO: `/v3/projects/4c5d4d5485a04e2eacc33d5ef8b4370f/users/5c00f2e0da2041e79bb006120236b85b/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.108777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1086/2192] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:47.109835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.113814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5d4d5485a04e2eacc33d5ef8b4370f, user_id=5c00f2e0da2041e79bb006120236b85b, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.118081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af8caf-a90c-4fd3-a20d-cdde281973ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.141632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1107/2193] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:47 2022] PUT /identity/v3/projects/4c5d4d5485a04e2eacc33d5ef8b4370f/users/5c00f2e0da2041e79bb006120236b85b/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:47.155266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230133-cab9-496a-b253-300c59abecc9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.155266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230133-cab9-496a-b253-300c59abecc9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.155575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19230133-cab9-496a-b253-300c59abecc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.193662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-19230133-cab9-496a-b253-300c59abecc9 None None] MFA Rules not processed for user `5c00f2e0da2041e79bb006120236b85b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:47.195714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-19230133-cab9-496a-b253-300c59abecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.231228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47665a4d-64bb-4a2a-9c07-3d917c7e9666 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.292281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1108/2194] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:47.305002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19230133-cab9-496a-b253-300c59abecc9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.308381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-19230133-cab9-496a-b253-300c59abecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.314776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.317565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.317847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.318169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.318893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.321597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.351631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1087/2195] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:47 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:47.354779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.368253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e63e-35c8-40f3-b6df-404237f92e0b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.374409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.375098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.375502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.375842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.376312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19230133-cab9-496a-b253-300c59abecc9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.376676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.378469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.380359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.381453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.382255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.382598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.392227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.394149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.394283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1088/2196] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:47.395447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.404401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1109/2197] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:47.408116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e0788-0266-4610-ae93-f409916567b0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.413459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.414157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.414438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.414705 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] PATH_INFO: `/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94/users/35ed4491eb154600ab5ec92a6adea226/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.426544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.426964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:47.432824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f0bb7b3b2643f38e37a294a4643d94, user_id=35ed4491eb154600ab5ec92a6adea226, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.435852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.439449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046c0eb-58e4-45d9-9c8a-efb47f44958f service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.445455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.446183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.446510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.446876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] PATH_INFO: `/v3/users/5c00f2e0da2041e79bb006120236b85b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.448058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c00f2e0da2041e79bb006120236b85b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.450241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.451364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1089/2198] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:47 2022] PUT /identity/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94/users/35ed4491eb154600ab5ec92a6adea226/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:47.454939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.530370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c00f2e0da2041e79bb006120236b85b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:47.531591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c00f2e0da2041e79bb006120236b85b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:47.547666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c00f2e0da2041e79bb006120236b85b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:47.554944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afc2-09ad-4b95-859c-ef23ba8d6231 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.562944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.563569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.564094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.564516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.565495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.567300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.568338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:47.580619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c00f2e0da2041e79bb006120236b85b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:47.581622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1090/2199] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:47.585851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.586190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153b65fc-469b-4771-af6e-8fdf746918c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c00f2e0da2041e79bb006120236b85b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:47.587796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.605927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1110/2200] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:47 2022] DELETE /identity/v3/users/5c00f2e0da2041e79bb006120236b85b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:47.611494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.612021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.612459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.614535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc91d-952b-4869-817a-be681d9ed425 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:47.636060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:47.638328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.754917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1111/2201] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:47.766188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:47.766624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.766915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.767189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] PATH_INFO: `/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94/users/35ed4491eb154600ab5ec92a6adea226/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.768646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:47.769622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f0bb7b3b2643f38e37a294a4643d94, user_id=35ed4491eb154600ab5ec92a6adea226, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:47.771811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.772757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8db36-70f1-45ee-9ed4-40fa5cdc2402 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:47.784627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1091/2202] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:47 2022] PUT /identity/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94/users/35ed4491eb154600ab5ec92a6adea226/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:47.795526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:47.795811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:47.796080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:47.846437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] MFA Rules not processed for user `35ed4491eb154600ab5ec92a6adea226`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:47.847962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:47.918838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d5c28-beb3-479f-bfe9-d0ccc678b31d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:48.007527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1092/2203] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:48.008506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:48.012964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:48.025512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:48.029357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:48.030812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:48.031288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:48.031659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:48.112519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:48.121454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddff16c-deec-4cc3-a103-ccf1d4799fbd None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:48.126000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:48.126615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:48.126895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:48.127159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:48.129912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:48.130870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:48.132658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:48.143907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1112/2204] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:48.289990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:48.293681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:48.315617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1093/2205] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:48.386617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:48.389344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:48.414448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20f42f-d41c-4ddf-8824-615b4ae38952 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:48.419629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:48.420726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:48.421149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:48.421708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:48.423683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:48.526057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:48.529064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8d10d-d962-4698-b8ad-f60487d79109 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:48.554265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1113/2206] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:48.774151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:48.775750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:48.823059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff84389-e172-42bc-bfcf-45c5cd30bed9 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:48.833454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:48.834112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:48.834394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:48.834697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] PATH_INFO: `/v3/projects/4c5d4d5485a04e2eacc33d5ef8b4370f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:48.840490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5d4d5485a04e2eacc33d5ef8b4370f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:48.842262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:48.948681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5d4d5485a04e2eacc33d5ef8b4370f', 'request_id': 'req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:48.959123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5d4d5485a04e2eacc33d5ef8b4370f', 'request_id': 'req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:48.973713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5d4d5485a04e2eacc33d5ef8b4370f', 'request_id': 'req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:48.991740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] The token cache is being invalidate because project 4c5d4d5485a04e2eacc33d5ef8b4370f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:48.992374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:48.993426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-42a8342e-63e2-4baa-8d98-7b61fbc2ac0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:48.995737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1094/2207] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:48 2022] DELETE /identity/v3/projects/4c5d4d5485a04e2eacc33d5ef8b4370f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:49.001444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.002142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.002464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.032199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:49.033628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:49.219701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1114/2208] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:49.228042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.228336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.228636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.282373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:49.284662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:49.296441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1095/2209] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:49.300638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.318397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d688bb-f0c4-4643-a4b8-5331e90b5338 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.336715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.336715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.336715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.336715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.337834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:49.337834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.337834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.359495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1115/2210] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:49.365395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.375667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655774d1-9b99-48d2-a2d0-93cab81cb9ea None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.380391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.381049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.381327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.381596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.382263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.384238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.414707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1096/2211] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:49 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:49.418906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.429303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcf638-4d94-4384-a1b7-be6efc429a07 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.450831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.453675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:49.471938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:49.501206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.502116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.502559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.502830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.503885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.505381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.529074 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705052f8-1ec0-440c-b04b-0efd9486b92f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.529800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1116/2212] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:49 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:49.533739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.540840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.541757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.541757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.541978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.544239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:49.545895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793138-0adf-434b-b347-2851c7997f1b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.551253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.551967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.552348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.552776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.553540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.555621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.559384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:49.577118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1117/2213] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:49.577981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.589393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf472-1311-4a40-811b-cdc05f13c773 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.595573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.596786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.597085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.597356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.597999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.601446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.620363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1118/2214] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:49.621321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:49.633446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117fb86-20a5-4cdf-9934-b406bea373fb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:49.640082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:49.640791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.641074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.641349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] PATH_INFO: `/v3/projects/90c14892f9be424bb545a150c237bae4/users/c47866176a5745d3a8de63a3238ce544/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.648014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.649435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4c9e9-ba44-411e-b29d-d5d03177dc5c service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.674970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1097/2215] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:49.708206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c14892f9be424bb545a150c237bae4, user_id=c47866176a5745d3a8de63a3238ce544, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:49.711315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:49.737097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1119/2216] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:49 2022] PUT /identity/v3/projects/90c14892f9be424bb545a150c237bae4/users/c47866176a5745d3a8de63a3238ce544/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:49.749329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:49.749669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:49.750516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:49.836721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] MFA Rules not processed for user `c47866176a5745d3a8de63a3238ce544`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:49.837978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:49.978110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1098/2217] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:49.991092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:50.096918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9c99-7fe8-4cb7-9bcc-a405a288d15b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:50.103462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:50.105239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:50.105836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:50.106250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:50.124258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:50.128701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:50.166145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1120/2218] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:50.704790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:50.716357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:50.755054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:50.758148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:50.769937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13ed9-4376-4815-bcc7-0624edeb1bee service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:50.774697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:50.775355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:50.775862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:50.776258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:50.778707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:50.800179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:50.818620 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5014ba-aac5-4f77-8f2a-16e4a74019ae None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:50.825775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:50.826420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:50.826700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:50.826970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] PATH_INFO: `/v3/users/0ae27430186b42b88d0ad7ba442fc7e6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:50.828503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae27430186b42b88d0ad7ba442fc7e6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:50.830555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:50.855134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:50.856802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:50.869797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1121/2219] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:50.905857 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae27430186b42b88d0ad7ba442fc7e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:50.916966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae27430186b42b88d0ad7ba442fc7e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:50.943677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae27430186b42b88d0ad7ba442fc7e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:50.944472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae27430186b42b88d0ad7ba442fc7e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:50.945444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-86166206-7ebd-4885-a53c-9c8487c17c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae27430186b42b88d0ad7ba442fc7e6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:50.978775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1099/2220] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:50 2022] DELETE /identity/v3/users/0ae27430186b42b88d0ad7ba442fc7e6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:51.252884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.274573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9754-32ac-438e-816f-f3ba3262757d service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.343764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.344539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.363535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.363939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] PATH_INFO: `/v3/projects/c18f75dffcd4435f88dbccbba8bd994b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.365400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18f75dffcd4435f88dbccbba8bd994b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.369235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.373992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:51.471046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18f75dffcd4435f88dbccbba8bd994b', 'request_id': 'req-419cb6df-21ab-444b-ac11-30b1d184b798'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:51.480371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18f75dffcd4435f88dbccbba8bd994b', 'request_id': 'req-419cb6df-21ab-444b-ac11-30b1d184b798'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:51.486718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18f75dffcd4435f88dbccbba8bd994b', 'request_id': 'req-419cb6df-21ab-444b-ac11-30b1d184b798'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:51.500065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] The token cache is being invalidate because project c18f75dffcd4435f88dbccbba8bd994b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:51.500470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:51.501228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-419cb6df-21ab-444b-ac11-30b1d184b798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:51.502999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1122/2221] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:51 2022] DELETE /identity/v3/projects/c18f75dffcd4435f88dbccbba8bd994b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:51.509066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.509355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.509629 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.535880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:51.537160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:51.602633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1100/2222] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:51.611055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.611258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.611592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.636778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:51.638097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:51.646412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1123/2223] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:51.651791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.661877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1027e21-acb2-46e1-82db-ca35a94bbe54 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.668352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.668994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.669269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.669448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.669545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.670167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:51.670467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.670877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:51.672113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.685380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1101/2224] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:26:51.690066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.700253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41988c6f-dbc7-47f1-a44d-9658fb575153 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.706487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.707314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.707463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.707739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.708553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.711209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.747309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1102/2225] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:51 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:51.751201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.756297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a76a06-3f77-40e5-a19f-12ce18bf0993 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.804623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:51.823827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.824498 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.824812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.825089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.826873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:51.829816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe62199-762b-4d6c-b314-0e9cd043150a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.834867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.835611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.836006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.836623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.837448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.839487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.874830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1103/2226] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:51 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:51.876092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.889601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:51.893189 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89550-02fe-4a36-b329-9f21b32a28da admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.902928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.903676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.903998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.904273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.905435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.908448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.909980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.911754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.923198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1104/2227] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:51.924388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1124/2228] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:51.927018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.940482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b000-a879-4560-96bb-33e39a9159f6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.947733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.948353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.948694 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.948935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:51.949584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:51.951430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36682f4-3a07-4ec1-9ce4-35a50475bde8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:51.963443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1105/2229] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:51.967818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:51.982998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b524e-9ff6-4262-8f51-015e53d4c27d service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:51.988745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:51.989496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:51.989782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:51.990137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] PATH_INFO: `/v3/projects/3a3805771b2c430cab4af011305c8a35/users/0f3bd501badf4ef1848cc25789cd2430/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.011430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3805771b2c430cab4af011305c8a35, user_id=0f3bd501badf4ef1848cc25789cd2430, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.014772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.031685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1125/2230] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:51 2022] PUT /identity/v3/projects/3a3805771b2c430cab4af011305c8a35/users/0f3bd501badf4ef1848cc25789cd2430/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:52.042653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.042932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.043245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.072595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] MFA Rules not processed for user `0f3bd501badf4ef1848cc25789cd2430`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:52.073954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:52.167280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.168570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1106/2231] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:52.267788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7910cf-c123-4a68-8b40-7d6358eab4de admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.277315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.282454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.282454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.282454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.282889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.289605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.344844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1126/2232] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:52 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:52.349391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.362371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa637657-0f03-4d5b-9200-a77d435a49ad None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.442099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.442745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.443023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.443460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.444138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.446154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.493684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1107/2233] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:52 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:52.498247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.513530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebe07-6f47-43ce-8e13-ca7609ef2e55 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.518705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.519332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.519637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.519959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.520671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.522823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.543608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1127/2234] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:52.547636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.559408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0fb2-932d-47c2-b8de-fb2c90f3a218 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.564293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.565014 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.565298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.565574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] PATH_INFO: `/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5/users/445dca14b2b547cd93da16ae61103622/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.583688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfc5a8c8ef24927a209de67700dc7f5, user_id=445dca14b2b547cd93da16ae61103622, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.588801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.606087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:52.608890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1108/2235] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:52 2022] PUT /identity/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5/users/445dca14b2b547cd93da16ae61103622/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:52.612887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.624650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198321-df70-4052-a0a6-4b9df58f6347 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.685617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.686413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.686788 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.687162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.687846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.689586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0f3b-49dd-4912-9677-6663e5c29d14 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.701947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1128/2236] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:52.706248 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.718509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919e6b0-96c5-4f62-91fe-c633ad681389 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.724818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.726109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.726569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.730233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] PATH_INFO: `/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5/users/445dca14b2b547cd93da16ae61103622/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.732427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfc5a8c8ef24927a209de67700dc7f5, user_id=445dca14b2b547cd93da16ae61103622, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.735306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.747969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1109/2237] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:52 2022] PUT /identity/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5/users/445dca14b2b547cd93da16ae61103622/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:52.759926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.760424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.760733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.794955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] MFA Rules not processed for user `445dca14b2b547cd93da16ae61103622`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:52.794955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:52.824136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:52.880018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1129/2238] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:52.892311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:52.894218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:52.957322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a64a7-babc-4b53-9556-7ab8d6198f3e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:52.966013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:52.966627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:52.966900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:52.967165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:52.977453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:52.979079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:52.988467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1110/2239] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:53.066534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:53.077260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157168c-2a6c-4fef-bfef-051d8670b0cb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:53.080904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:53.081504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:53.081855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:53.082189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:53.143495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:53.145362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8369de3-454f-4a1b-811f-cda8be175f9e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:53.156532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1130/2240] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:53.623653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:53.625120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:53.695787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf5c4a-9283-451d-834e-ea92fd33bd8a service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:53.703869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:53.704738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:53.705022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:53.705291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] PATH_INFO: `/v3/users/c47866176a5745d3a8de63a3238ce544` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:53.707890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47866176a5745d3a8de63a3238ce544)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:53.710463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:53.783896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47866176a5745d3a8de63a3238ce544'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:53.794244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47866176a5745d3a8de63a3238ce544'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:53.816465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47866176a5745d3a8de63a3238ce544'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:53.817509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47866176a5745d3a8de63a3238ce544'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:53.818495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47866176a5745d3a8de63a3238ce544'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:53.834265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1111/2241] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:53 2022] DELETE /identity/v3/users/c47866176a5745d3a8de63a3238ce544 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:53.838797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:53.839232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:53.839406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:53.860592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:53.861826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:53.927263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1131/2242] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:53.937653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:53.939060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:53.950303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:54.003665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a787d9-c322-41d9-bb08-0383701fdb28 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.007560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.008223 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.008437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.008820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.012331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.018862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.024656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.026408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aaa66-fcca-4416-b006-25f58cfa9d61 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.032275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0d60-f480-494b-9cf4-8e9fe5c64a5b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.036702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1112/2243] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:54.037399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.039214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.039494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.039758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] PATH_INFO: `/v3/users/ea1e9be3400e4c7ba2e744e648233b96` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.040945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1e9be3400e4c7ba2e744e648233b96)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.042876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.094800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1e9be3400e4c7ba2e744e648233b96'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.096975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1e9be3400e4c7ba2e744e648233b96'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.110981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1e9be3400e4c7ba2e744e648233b96'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.112087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:54.125503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1e9be3400e4c7ba2e744e648233b96'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.127842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1e9be3400e4c7ba2e744e648233b96'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.142688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1132/2244] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:54 2022] DELETE /identity/v3/users/ea1e9be3400e4c7ba2e744e648233b96 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:54.147389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.148184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.148452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.168616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:54.170927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.259751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1113/2245] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:54.270150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.271606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.344118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.345709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.358878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0e8d3-6d0b-4fcc-aa97-7542415c68f3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.366651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.367551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.367685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d2b9-1ef0-43ff-8657-fd1dccf90444 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.368015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.368400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.373364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.373995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.374270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.374543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] PATH_INFO: `/v3/projects/90c14892f9be424bb545a150c237bae4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.375743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c14892f9be424bb545a150c237bae4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.377870 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.380961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.383248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4114620-2d06-48db-a8ee-47e9d2d0b9b2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.399552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1133/2246] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:54.454061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c14892f9be424bb545a150c237bae4', 'request_id': 'req-5ac84d62-0a79-48eb-a838-594e8fbdec67'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.477132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c14892f9be424bb545a150c237bae4', 'request_id': 'req-5ac84d62-0a79-48eb-a838-594e8fbdec67'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.488505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c14892f9be424bb545a150c237bae4', 'request_id': 'req-5ac84d62-0a79-48eb-a838-594e8fbdec67'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.508152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] The token cache is being invalidate because project 90c14892f9be424bb545a150c237bae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:54.511561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.513294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5ac84d62-0a79-48eb-a838-594e8fbdec67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:54.515059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1114/2247] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:54 2022] DELETE /identity/v3/projects/90c14892f9be424bb545a150c237bae4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:54.521164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.521720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.522111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.558822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:54.561666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.714668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1134/2248] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:54.721509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.721840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.722203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.758296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:54.763834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.782452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1115/2249] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:54.787211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.806273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4b68-3223-4b01-a920-e1811e0a7e99 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.817242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.820080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:54.823507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.824231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.824519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.824918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.825582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:54.825889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.841153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.858643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c515a7-9b4e-4688-b395-a8fff5076839 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.875407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1135/2250] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:54.895492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.895492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.895492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.895721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:54.895798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] PATH_INFO: `/v3/projects/77f3994124db4926b8f4566ea073941b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.895798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f3994124db4926b8f4566ea073941b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.895798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:54.922854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:54.924011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5aeb-da16-4dc6-aa95-fe26f1a0ce95 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:54.937987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:54.939276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:54.939681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:54.946793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:54.946793 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:54.971845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.010269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f3994124db4926b8f4566ea073941b', 'request_id': 'req-958b5407-b697-44c6-82de-6a9042660723'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.020475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f3994124db4926b8f4566ea073941b', 'request_id': 'req-958b5407-b697-44c6-82de-6a9042660723'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.023289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1136/2251] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:54 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:55.027523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.031302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f3994124db4926b8f4566ea073941b', 'request_id': 'req-958b5407-b697-44c6-82de-6a9042660723'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.049498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] The token cache is being invalidate because project 77f3994124db4926b8f4566ea073941b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:55.049911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.051060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.053186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1116/2252] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:54 2022] DELETE /identity/v3/projects/77f3994124db4926b8f4566ea073941b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:55.058004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.059410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:55.094452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:55.119477 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f91d-210d-4eac-b262-5f1595ed23d1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.125429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.126038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.126319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.126591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.127221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.129181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.167645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1137/2253] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:55 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:55.167645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.167825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5407-b697-44c6-82de-6a9042660723 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.167825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.167825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.167825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.168163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] PATH_INFO: `/v3/users/28200283144f48ee970bf8a88cd30470` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.168795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28200283144f48ee970bf8a88cd30470)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.169319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:55.171004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.182385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a311-3f69-4b79-9fde-4618a77902b3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.188092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.188812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.189156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.189594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.190300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.191897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.205443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1138/2254] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:55.209537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.220826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e7752-eafe-4d06-b9d4-ce2afb2207bb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.225791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.226874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.227152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.227419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.228007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28200283144f48ee970bf8a88cd30470'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.228132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.229656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.235375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28200283144f48ee970bf8a88cd30470'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.243039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1139/2255] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:55.248030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.249220 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28200283144f48ee970bf8a88cd30470'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.249923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28200283144f48ee970bf8a88cd30470'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.250538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d2854931-654e-4a50-a7c6-c09bf09a0ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28200283144f48ee970bf8a88cd30470'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.258696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb71f-9ff7-484b-8d2c-cc3891b01951 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.263849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.264449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.267575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.267704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1117/2256] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:55 2022] DELETE /identity/v3/users/28200283144f48ee970bf8a88cd30470 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:55.267816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] PATH_INFO: `/v3/projects/c0b660f2adb449dbab6670964e84b75f/users/3f6df1526de84b369b7233dce0021399/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.284503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b660f2adb449dbab6670964e84b75f, user_id=3f6df1526de84b369b7233dce0021399, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.287302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.300674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1140/2257] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:55 2022] PUT /identity/v3/projects/c0b660f2adb449dbab6670964e84b75f/users/3f6df1526de84b369b7233dce0021399/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:55.312133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.312530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.312836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.351265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] MFA Rules not processed for user `3f6df1526de84b369b7233dce0021399`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:55.353030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:55.376152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:55.445527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1118/2258] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:55.457698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.459545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:55.552930 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7aa0-b5f5-43d7-8e9d-14d8e696ceac admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.557279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.557888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.558169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.558440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.562683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.564136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:55.568003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.570150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.580991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1141/2259] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:55.639243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1470c1-a113-4e2c-880d-0ab3653e7662 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.644650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.645412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.645566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.645828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] PATH_INFO: `/v3/projects/1227b9761e8145508af33829387db31f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.647007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1227b9761e8145508af33829387db31f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.650173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.705742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1227b9761e8145508af33829387db31f', 'request_id': 'req-826a3840-785d-4c06-9227-fc63b90b75fb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.714642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1227b9761e8145508af33829387db31f', 'request_id': 'req-826a3840-785d-4c06-9227-fc63b90b75fb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.724485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1227b9761e8145508af33829387db31f', 'request_id': 'req-826a3840-785d-4c06-9227-fc63b90b75fb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.742497 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] The token cache is being invalidate because project 1227b9761e8145508af33829387db31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:55.742893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.743868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.748556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1119/2260] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:55 2022] DELETE /identity/v3/projects/1227b9761e8145508af33829387db31f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:55.750113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:55.763430 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58236f5-7f74-4e28-b1a0-34f5b8e7e94f service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:55.834766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:55.836249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:55.836529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:55.836829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] PATH_INFO: `/v3/users/7ce4f07fba8b4e6c995311009e79a872` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:55.837971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce4f07fba8b4e6c995311009e79a872)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:55.840612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:55.851013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:55.894240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce4f07fba8b4e6c995311009e79a872'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.894983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce4f07fba8b4e6c995311009e79a872'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.904946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce4f07fba8b4e6c995311009e79a872'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.919116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce4f07fba8b4e6c995311009e79a872'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.919956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce4f07fba8b4e6c995311009e79a872'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:55.933188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1142/2261] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:55 2022] DELETE /identity/v3/users/7ce4f07fba8b4e6c995311009e79a872 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:56.356227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.357896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.364799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.367078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.372983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a3840-785d-4c06-9227-fc63b90b75fb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.473424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.490463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.491698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5e95-509b-4991-b395-8cfbc9cc2cad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.492229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.492360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.492640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] PATH_INFO: `/v3/users/a3459db6ab3843f89928842ac253a2a7` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.495787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3459db6ab3843f89928842ac253a2a7)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.496766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.497449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.498943 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.499483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.499861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] PATH_INFO: `/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.501249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8782f65d6c7a4a8e9702b7b633e394b3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.503366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.575009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8782f65d6c7a4a8e9702b7b633e394b3', 'request_id': 'req-863b0a03-e630-49c8-b01b-983dad8a36b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.575530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3459db6ab3843f89928842ac253a2a7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.582251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8782f65d6c7a4a8e9702b7b633e394b3', 'request_id': 'req-863b0a03-e630-49c8-b01b-983dad8a36b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.583480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3459db6ab3843f89928842ac253a2a7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.588819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8782f65d6c7a4a8e9702b7b633e394b3', 'request_id': 'req-863b0a03-e630-49c8-b01b-983dad8a36b5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.599609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3459db6ab3843f89928842ac253a2a7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.600553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3459db6ab3843f89928842ac253a2a7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.602156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c23bff95-8340-411a-ab11-4efcd12f0ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3459db6ab3843f89928842ac253a2a7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.604966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] The token cache is being invalidate because project 8782f65d6c7a4a8e9702b7b633e394b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:56.605385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.606068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-863b0a03-e630-49c8-b01b-983dad8a36b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:56.607892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1143/2262] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:56 2022] DELETE /identity/v3/projects/8782f65d6c7a4a8e9702b7b633e394b3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:56.612826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc1ae-6e0e-4f5c-b71b-1fa2d9743229 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.613090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc1ae-6e0e-4f5c-b71b-1fa2d9743229 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.613394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc1ae-6e0e-4f5c-b71b-1fa2d9743229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.620454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1120/2263] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:56 2022] DELETE /identity/v3/users/a3459db6ab3843f89928842ac253a2a7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:56.625252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.625543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.626125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.638617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-498fc1ae-6e0e-4f5c-b71b-1fa2d9743229 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:56.640749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-498fc1ae-6e0e-4f5c-b71b-1fa2d9743229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.652508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:56.653772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.658580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.712683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1144/2264] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:56.717665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1121/2265] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:56.720708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.721159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.721256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.727099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.728753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.742362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:56.743635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:56.753094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1145/2266] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:56.758509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.770170 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9080dc-07b3-4498-b9b4-07bb0b1d0b8f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.774858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.775460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.775734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.776001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.776736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:56.777037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.778713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.791515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5950-f96e-417e-b280-f9f1dae91830 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.791672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1146/2267] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:56.795727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.796745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.797444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.797790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.798123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.806155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe134-4926-4b6c-baf6-3e9a86b9a1af admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.808972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.810814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.812149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.812844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.813132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.813483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.814128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.816040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.823485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1122/2268] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:56.860737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1147/2269] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:56 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:26:56.863156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.874609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291626-db17-4fdb-9184-54cc1db9bf60 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:56.885961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.947300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:56.947910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:56.948608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:56.948608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:56.949118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:56.951053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:56.982510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1123/2270] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:56 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:56.982797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:56.996795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab0e9-06d9-48fc-b735-bcb3fb3c493a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.001807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.002442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.002754 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.007712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.008471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.010359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.021224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1148/2271] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:57.025427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.035762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd966f4-d70d-47c3-ab92-a30ce861b287 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.042047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.042844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.042960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.043181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.043969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.045862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.057375 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1124/2272] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:57.061914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.074538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c253b-55f4-405c-a8b0-8e24bd9c0c7d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.079350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.080014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.080280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.080553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] PATH_INFO: `/v3/projects/b0ea853ab41d415d863ce8e512d0eac5/users/e8257392699b493cbecd42ceb62ddff5/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.097925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ea853ab41d415d863ce8e512d0eac5, user_id=e8257392699b493cbecd42ceb62ddff5, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.101494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff783386-f837-48ff-933c-2f65a0bb25fe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.117434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1149/2273] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:57 2022] PUT /identity/v3/projects/b0ea853ab41d415d863ce8e512d0eac5/users/e8257392699b493cbecd42ceb62ddff5/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:57.122852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.123655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.123770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.123993 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.125608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:57.143681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca503c-c41d-45d0-94be-088ef63cebbc admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.168390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:57.169833 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:57.226683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.227668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.227954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.228226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] PATH_INFO: `/v3/projects/a633ac9c7123472f8ae3e6eecabc5fee` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.229455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a633ac9c7123472f8ae3e6eecabc5fee)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.231617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.245180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1150/2274] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:57.255935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.284289 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a633ac9c7123472f8ae3e6eecabc5fee', 'request_id': 'req-0b42bbd2-4984-498e-a5a2-258ab263680b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.293974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a633ac9c7123472f8ae3e6eecabc5fee', 'request_id': 'req-0b42bbd2-4984-498e-a5a2-258ab263680b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.301258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a633ac9c7123472f8ae3e6eecabc5fee', 'request_id': 'req-0b42bbd2-4984-498e-a5a2-258ab263680b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.309315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:57.315550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] The token cache is being invalidate because project a633ac9c7123472f8ae3e6eecabc5fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:57.315665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.316277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.317893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1125/2275] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:57 2022] DELETE /identity/v3/projects/a633ac9c7123472f8ae3e6eecabc5fee => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:57.322016 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.323670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:57.325864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0921-8a92-4f85-a5fb-f57c6d9465ce None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.353632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:57.387697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.388293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.388592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.388865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.390642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:57.411963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42bbd2-4984-498e-a5a2-258ab263680b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:57.422304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:57.422958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:57.423341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:57.423701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] PATH_INFO: `/v3/users/a10251cc54f64d4bb1e3a36ad4c745cf` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:57.424964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10251cc54f64d4bb1e3a36ad4c745cf)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.426926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.497776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:57.499844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:57.501169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10251cc54f64d4bb1e3a36ad4c745cf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.510358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10251cc54f64d4bb1e3a36ad4c745cf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.514538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1151/2276] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:57.534529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10251cc54f64d4bb1e3a36ad4c745cf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.536385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10251cc54f64d4bb1e3a36ad4c745cf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.537217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10251cc54f64d4bb1e3a36ad4c745cf'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:57.553307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1126/2277] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:57 2022] DELETE /identity/v3/users/a10251cc54f64d4bb1e3a36ad4c745cf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:57.959920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:57.980086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed890154-3604-45b2-a99c-b0aabd2306cd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:58.064155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:58.064864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:58.065214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:58.065487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] PATH_INFO: `/v3/projects/ea87c1be573b43f1af61b4ecdf787cdc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:58.066682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea87c1be573b43f1af61b4ecdf787cdc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:58.068855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:58.153677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea87c1be573b43f1af61b4ecdf787cdc', 'request_id': 'req-1057013f-d08e-4561-988f-4771aafa7250'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.155092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:58.166401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea87c1be573b43f1af61b4ecdf787cdc', 'request_id': 'req-1057013f-d08e-4561-988f-4771aafa7250'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.173449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea87c1be573b43f1af61b4ecdf787cdc', 'request_id': 'req-1057013f-d08e-4561-988f-4771aafa7250'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.193121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] The token cache is being invalidate because project ea87c1be573b43f1af61b4ecdf787cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:58.193415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.194541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1057013f-d08e-4561-988f-4771aafa7250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.204034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1152/2278] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:57 2022] DELETE /identity/v3/projects/ea87c1be573b43f1af61b4ecdf787cdc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:58.210626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:58.212241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:58.228736 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536b56-2d7e-4937-a69c-ae3a25eb7ab3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:58.315526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:58.316207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:58.316550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:58.317009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] PATH_INFO: `/v3/users/35ed4491eb154600ab5ec92a6adea226` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:58.319197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ed4491eb154600ab5ec92a6adea226)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:58.322015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:58.386383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:58.395683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ed4491eb154600ab5ec92a6adea226'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.397695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:58.398329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:58.398631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:58.421403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ed4491eb154600ab5ec92a6adea226'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.440271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] MFA Rules not processed for user `e8257392699b493cbecd42ceb62ddff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:58.441782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:58.445146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ed4491eb154600ab5ec92a6adea226'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.448645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ed4491eb154600ab5ec92a6adea226'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.449492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ed4491eb154600ab5ec92a6adea226'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:58.470812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1127/2279] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:58 2022] DELETE /identity/v3/users/35ed4491eb154600ab5ec92a6adea226 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:58.527097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1153/2280] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:58.536648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:58.539477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:58.619724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a48c-6ad9-4646-bc9c-8e7b3986302a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:58.624181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:58.624804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:58.625087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:58.625359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:58.722774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:58.727589 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:58.742195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1128/2281] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:58.915486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:58.917290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:58.933063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:58.935108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:58.956388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea2d4-3915-4e8d-83a7-6ba7be072db0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.033919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6e1bf-4358-4ffd-9199-2c52c17081d1 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.038792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.039525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.039827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.040114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] PATH_INFO: `/v3/users/4ed5ae286d0545b7a24c393306945f3d` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.041358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed5ae286d0545b7a24c393306945f3d)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.043399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.063192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.064068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.064483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.064940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] PATH_INFO: `/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.066349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f0bb7b3b2643f38e37a294a4643d94)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.068479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.069315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.145735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f0bb7b3b2643f38e37a294a4643d94', 'request_id': 'req-3595072c-a838-4811-aae8-7845b09f15a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.153970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed5ae286d0545b7a24c393306945f3d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.154679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f0bb7b3b2643f38e37a294a4643d94', 'request_id': 'req-3595072c-a838-4811-aae8-7845b09f15a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.162079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f0bb7b3b2643f38e37a294a4643d94', 'request_id': 'req-3595072c-a838-4811-aae8-7845b09f15a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.167106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed5ae286d0545b7a24c393306945f3d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.178011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.186294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] The token cache is being invalidate because project f8f0bb7b3b2643f38e37a294a4643d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:59.186629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.187558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3595072c-a838-4811-aae8-7845b09f15a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.189747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1154/2282] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:58 2022] DELETE /identity/v3/projects/f8f0bb7b3b2643f38e37a294a4643d94 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:59.204532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289a16-3368-4fad-a9fa-257be4f51d09 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.204532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289a16-3368-4fad-a9fa-257be4f51d09 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.204532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289a16-3368-4fad-a9fa-257be4f51d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.205108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed5ae286d0545b7a24c393306945f3d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.205108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed5ae286d0545b7a24c393306945f3d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.205678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e50818bc-86e5-465c-999f-d320fccc0a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed5ae286d0545b7a24c393306945f3d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:59.226475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-46289a16-3368-4fad-a9fa-257be4f51d09 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:59.227714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-46289a16-3368-4fad-a9fa-257be4f51d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.230949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1129/2283] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:58 2022] DELETE /identity/v3/users/4ed5ae286d0545b7a24c393306945f3d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:26:59.238124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.238451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.238751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.264520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:59.265849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.301032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1155/2284] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:59.309590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.310049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.310162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.333847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1130/2285] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:59.334548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:59.336440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.344406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.344862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1156/2286] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:26:59.348017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.348925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.359287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a1c54-a811-4c05-abd2-a247576c18b3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.363968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.364784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.365064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.365340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.366251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:26:59.367167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.368942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.380947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1157/2287] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:26:59.385263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.396524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2715d58-ed91-45c4-b5a1-220234c82200 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.401448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.402028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.402334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.402603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.403213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.405150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.407423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c16331-634f-4f57-a158-95b00fb0b15c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.411668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.412267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.412704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.413623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.424517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.426031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.433898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1158/2288] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:59.445802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1131/2289] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:26:59.446440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.525191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61080f-0ce8-4049-a4a8-a99b62b79806 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.530537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.531218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.531506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.532393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.533077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.535202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.568420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1159/2290] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:26:59.573753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.586557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f671-493a-43d1-b1f1-fc6e7237a11c service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.591773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.592458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.592834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.593236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.594130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.596346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.611784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1132/2291] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:26:59.623220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.637701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226a33-4923-4879-b4d3-a4858d6a7aef admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.645748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.646431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.646880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.650277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.650277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.651174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe3308-5c1e-4b72-820b-c4565f301e4d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.669507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1160/2292] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:26:59.671123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.682976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb92b59-b17a-44ae-badc-d412da918635 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.688606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.689421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.689884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.690112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] PATH_INFO: `/v3/projects/f942e3c5834e440c8814e95758333890/users/8671b1513f1b4db6bdf1d0c87f828e53/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.721049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f942e3c5834e440c8814e95758333890, user_id=8671b1513f1b4db6bdf1d0c87f828e53, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.722304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:59.739204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1133/2293] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:26:59 2022] PUT /identity/v3/projects/f942e3c5834e440c8814e95758333890/users/8671b1513f1b4db6bdf1d0c87f828e53/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:59.751798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.752093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.752559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.795538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] MFA Rules not processed for user `8671b1513f1b4db6bdf1d0c87f828e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:26:59.797063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.810158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.813185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.819186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.858374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.921160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff828-7fd9-4dae-8286-b6a7dac5c585 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:59.921495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1161/2294] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:26:59.930051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:59.930703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:59.930982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:59.931254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] PATH_INFO: `/v3/projects/30919561024f4edea63417e757affba6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:59.932956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30919561024f4edea63417e757affba6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:59.933340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:59.934771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:59.935138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.005894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30919561024f4edea63417e757affba6', 'request_id': 'req-f1576e12-b038-4673-88ae-4954baf2163c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.017163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30919561024f4edea63417e757affba6', 'request_id': 'req-f1576e12-b038-4673-88ae-4954baf2163c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.018524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528bc8-cfd8-4758-be23-885b4d04a8e7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.029732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30919561024f4edea63417e757affba6', 'request_id': 'req-f1576e12-b038-4673-88ae-4954baf2163c'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.045951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] The token cache is being invalidate because project 30919561024f4edea63417e757affba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:00.046245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.047086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f1576e12-b038-4673-88ae-4954baf2163c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.048841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1134/2295] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:59 2022] DELETE /identity/v3/projects/30919561024f4edea63417e757affba6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:00.054021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914e2b-cc16-4393-9495-a15cf2030310 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.054306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914e2b-cc16-4393-9495-a15cf2030310 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.054714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914e2b-cc16-4393-9495-a15cf2030310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.080810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-20914e2b-cc16-4393-9495-a15cf2030310 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:00.082137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-20914e2b-cc16-4393-9495-a15cf2030310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.084159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.085502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.085785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.086184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.089153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.153148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1135/2296] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:00.157986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.159509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.161506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.161863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.162100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.169421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1162/2297] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:00.182900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:00.184098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.193197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1136/2298] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:00.197781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.201672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.203535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.211004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18616b9f-72ab-4a57-974a-608d16f19f34 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.217921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.218596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.218701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc628801-dff0-41df-be36-8507e39e04ac None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.218942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.219298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.220006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:00.220379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.222187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.231741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.232830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.233612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.233899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] PATH_INFO: `/v3/users/8671b1513f1b4db6bdf1d0c87f828e53` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.235313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8671b1513f1b4db6bdf1d0c87f828e53)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.236640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1163/2299] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:00.237287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.242458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.253828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37abdc-a7e6-41db-95c4-f2777e738c9d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.259091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.259721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.260071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.260471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.261346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.263272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.263388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee506-cf56-45ca-978e-c0fc21b3f9b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.291649 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.299525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8671b1513f1b4db6bdf1d0c87f828e53'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.300528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1164/2300] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:00.301911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd65e-9ddc-4877-96d2-3d8ffc0994f9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.302238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd65e-9ddc-4877-96d2-3d8ffc0994f9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.302514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffd65e-9ddc-4877-96d2-3d8ffc0994f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.308919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8671b1513f1b4db6bdf1d0c87f828e53'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.323213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8671b1513f1b4db6bdf1d0c87f828e53'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.323338 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d3ffd65e-9ddc-4877-96d2-3d8ffc0994f9 None None] MFA Rules not processed for user `e8257392699b493cbecd42ceb62ddff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:00.324285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8671b1513f1b4db6bdf1d0c87f828e53'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.324421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d3ffd65e-9ddc-4877-96d2-3d8ffc0994f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.325402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8671b1513f1b4db6bdf1d0c87f828e53'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.349224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1137/2301] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:00 2022] DELETE /identity/v3/users/8671b1513f1b4db6bdf1d0c87f828e53 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:00.350241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.352087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.393390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1165/2302] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:00.394561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.394859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.395134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.419013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:00.420614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.430308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1166/2303] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:00.433699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d15893-8a0e-4b55-9230-ebc07bf8e75f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.438680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.439302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.439581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.439851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.440465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.440595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.442113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.442472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.469272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1138/2304] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:00.470505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.483704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442de56-f5df-448e-8f09-f277f25490b5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.488481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.489108 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.490039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.490314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.491505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.493185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.505784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1139/2305] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:00.510593 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.512136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f588f13-74ac-4fcd-b7b4-a632cefb8337 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.515905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.516510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.516842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.517116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.520528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9340b-c110-4d87-91b8-cf8f93daa581 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.525816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.526527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.526812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.527079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.527194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.527758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.528690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.529603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85f083-4c76-460d-bda0-8d615d449ad9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.540203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1167/2306] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:00.543849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1140/2307] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:00.545097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.554981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061fd03-5300-4278-8d2d-962ea279e2d5 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.559825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.560561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.560876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.561328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] PATH_INFO: `/v3/projects/c38a95ad75b24fb3b1eed016b004f370/users/4e84e870c58e41bcb29984c54c608a45/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.578618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38a95ad75b24fb3b1eed016b004f370, user_id=4e84e870c58e41bcb29984c54c608a45, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.581277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.596349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1168/2308] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:00 2022] PUT /identity/v3/projects/c38a95ad75b24fb3b1eed016b004f370/users/4e84e870c58e41bcb29984c54c608a45/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:00.607928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.608210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.608491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.643978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] MFA Rules not processed for user `4e84e870c58e41bcb29984c54c608a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:00.645394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.717302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.724754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1141/2309] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:00.835631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:00.837621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:00.927199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f3d4-0176-416d-8e0d-d35365033fef admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:00.932813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:00.933434 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:00.933708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:00.933982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] PATH_INFO: `/v3/projects/f942e3c5834e440c8814e95758333890` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:00.935084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f942e3c5834e440c8814e95758333890)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:00.937020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:00.958948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.988684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f942e3c5834e440c8814e95758333890', 'request_id': 'req-625dc8d7-7621-4b43-b397-5345f238408f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:00.997389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f942e3c5834e440c8814e95758333890', 'request_id': 'req-625dc8d7-7621-4b43-b397-5345f238408f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.006511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f942e3c5834e440c8814e95758333890', 'request_id': 'req-625dc8d7-7621-4b43-b397-5345f238408f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.022097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:01.023542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:01.025136 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] The token cache is being invalidate because project f942e3c5834e440c8814e95758333890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:01.025435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.026182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-625dc8d7-7621-4b43-b397-5345f238408f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.027758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1169/2310] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:00 2022] DELETE /identity/v3/projects/f942e3c5834e440c8814e95758333890 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:01.052308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce610a-8daa-474e-8ce4-c6efe4f8f3ba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:01.152601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:01.153386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:01.153669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:01.153942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] PATH_INFO: `/v3/users/0f3bd501badf4ef1848cc25789cd2430` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:01.155208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3bd501badf4ef1848cc25789cd2430)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:01.157247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:01.227272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3bd501badf4ef1848cc25789cd2430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.235951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3bd501badf4ef1848cc25789cd2430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.255825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3bd501badf4ef1848cc25789cd2430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.256596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3bd501badf4ef1848cc25789cd2430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.257353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3bd501badf4ef1848cc25789cd2430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.270316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1142/2311] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:01 2022] DELETE /identity/v3/users/0f3bd501badf4ef1848cc25789cd2430 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:01.275552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:01.276021 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:01.276112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:01.295759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:01.297040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:01.357747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1170/2312] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:01.367789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:01.369268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:01.433770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187395-40e0-436f-a35f-0a3319cde2e2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:01.440331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:01.440975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:01.441254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:01.441523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:01.451247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:01.452697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:01.462606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1143/2313] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:01.740266 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:01.741981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:01.754760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e7275-cda6-4b60-95b7-365a8655412b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:01.760291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:01.760949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:01.761225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:01.761490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] PATH_INFO: `/v3/projects/3a3805771b2c430cab4af011305c8a35` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:01.762599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3805771b2c430cab4af011305c8a35)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:01.765237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:01.815981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3805771b2c430cab4af011305c8a35', 'request_id': 'req-abf73cf3-7d05-4268-bbad-50c1fe529b29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.824176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3805771b2c430cab4af011305c8a35', 'request_id': 'req-abf73cf3-7d05-4268-bbad-50c1fe529b29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.829608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3805771b2c430cab4af011305c8a35', 'request_id': 'req-abf73cf3-7d05-4268-bbad-50c1fe529b29'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.842634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] The token cache is being invalidate because project 3a3805771b2c430cab4af011305c8a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:01.842923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.843535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.845064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1171/2314] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:01 2022] DELETE /identity/v3/projects/3a3805771b2c430cab4af011305c8a35 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:01.849093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:01.859347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249981-4bf0-4c8e-92f2-3e0dcb5745a5 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:01.871596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:01.924415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:01.925063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:01.925339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:01.925608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] PATH_INFO: `/v3/users/445dca14b2b547cd93da16ae61103622` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:01.926702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445dca14b2b547cd93da16ae61103622)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:01.929194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:01.975070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445dca14b2b547cd93da16ae61103622'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.982303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445dca14b2b547cd93da16ae61103622'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.996312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445dca14b2b547cd93da16ae61103622'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.997171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445dca14b2b547cd93da16ae61103622'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:01.997862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bcfcba37-c8a0-467a-a6a0-706b469e5f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445dca14b2b547cd93da16ae61103622'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.014663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1144/2315] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:01 2022] DELETE /identity/v3/users/445dca14b2b547cd93da16ae61103622 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:02.297522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.299051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:02.323543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf73cf3-7d05-4268-bbad-50c1fe529b29 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.362151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:02.396225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.396911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.397215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.397540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] PATH_INFO: `/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.398711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfc5a8c8ef24927a209de67700dc7f5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.400782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.453657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfc5a8c8ef24927a209de67700dc7f5', 'request_id': 'req-570a7ce6-553a-4a93-9168-c48ad8bc3e81'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.460759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfc5a8c8ef24927a209de67700dc7f5', 'request_id': 'req-570a7ce6-553a-4a93-9168-c48ad8bc3e81'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.466372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfc5a8c8ef24927a209de67700dc7f5', 'request_id': 'req-570a7ce6-553a-4a93-9168-c48ad8bc3e81'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.479576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] The token cache is being invalidate because project 5bfc5a8c8ef24927a209de67700dc7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:02.479870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.480499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-570a7ce6-553a-4a93-9168-c48ad8bc3e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:02.482031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1172/2316] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:02 2022] DELETE /identity/v3/projects/5bfc5a8c8ef24927a209de67700dc7f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:02.488781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.488781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.488781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.508740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:02.510164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:02.571176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1145/2317] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:02.578751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df693-c622-49e4-983f-cb179faf567a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.579038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df693-c622-49e4-983f-cb179faf567a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.579312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df693-c622-49e4-983f-cb179faf567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.603070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-840df693-c622-49e4-983f-cb179faf567a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:02.604306 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-840df693-c622-49e4-983f-cb179faf567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:02.612640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1173/2318] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:02.618770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.630285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e247b-a1fc-4e83-a382-ecbf074b070f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.635203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.635813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.636100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.636372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.637077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:02.637412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.639075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.651688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1146/2319] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:02.656217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df693-c622-49e4-983f-cb179faf567a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.666093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df693-c622-49e4-983f-cb179faf567a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.670804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.671419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.671677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.671948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.672606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.674492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.702031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1174/2320] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:02 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:02.706317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.717475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a926f-02c5-43fe-a69d-8cda25d1b667 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.738816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:02.778383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.778900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.779176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.779441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.780074 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.782013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.804352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1147/2321] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:02 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:02.808709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.819370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e2412-0a9f-43a9-b85a-071e8c7be377 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.824403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.825045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.825316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.825583 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.826218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.827802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.839661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1175/2322] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:02.843900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.854844 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ff54c-0023-47dc-be94-4496d98988ff admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.859675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.860271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.860546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.860842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.861505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.863096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4870-6b6e-4bbc-9655-edadb7391a53 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.873888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1148/2323] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:02.878411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:02.888375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e8b8-03b9-4708-8fd8-4e7a807d1a45 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:02.893016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:02.893651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.895250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.895571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] PATH_INFO: `/v3/projects/097af989dd3b42ca8aa8d25ed00e0291/users/0c3f8d765991411093ef9dac8d3aac03/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.911373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=097af989dd3b42ca8aa8d25ed00e0291, user_id=0c3f8d765991411093ef9dac8d3aac03, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:02.915267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:02.928193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1176/2324] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:02 2022] PUT /identity/v3/projects/097af989dd3b42ca8aa8d25ed00e0291/users/0c3f8d765991411093ef9dac8d3aac03/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:02.938988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:02.939295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:02.939563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:02.969105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] MFA Rules not processed for user `0c3f8d765991411093ef9dac8d3aac03`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:02.970312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:03.034587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1149/2325] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:03.039650 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.097652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:03.102110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a57be-f116-4f91-b1e8-174f279efc9d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.108317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.109117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.109432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.109989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.110785 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.112752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.140044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1177/2326] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:03 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:03.144113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.155572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa4ed2-807d-4b63-acb5-3f1d7761a618 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.213352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.213981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.214228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.214503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.215127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.217075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.239954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1150/2327] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:03 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:03.245251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.255822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cdc28-57f8-4af1-9b31-ce7e1a5dd3dc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.261393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.261991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.262271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.262537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.263176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.264806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.276264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1178/2328] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:03.280552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.291438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f11433-15f0-45e5-aed3-471d98d3340d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.296512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.297212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.297487 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.297756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] PATH_INFO: `/v3/projects/32f908c15b004911acc1caa1becf98ea/users/b5fdc6b9d489495d8752513fe21cdcd7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.313618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f908c15b004911acc1caa1becf98ea, user_id=b5fdc6b9d489495d8752513fe21cdcd7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.316336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.324733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:03.330404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1151/2329] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:03 2022] PUT /identity/v3/projects/32f908c15b004911acc1caa1becf98ea/users/b5fdc6b9d489495d8752513fe21cdcd7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:03.334374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.345485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8db45-878e-41c3-9972-446e529dc4c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.408165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.408805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.409088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.409362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.410029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.411606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9876f3-3792-4faa-b1e9-4517994152ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.421933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1179/2330] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:03.426020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.436666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3813-a842-476a-874b-90d926865a03 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.441214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.441855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.442131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.442396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] PATH_INFO: `/v3/projects/32f908c15b004911acc1caa1becf98ea/users/b5fdc6b9d489495d8752513fe21cdcd7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.445177 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f908c15b004911acc1caa1becf98ea, user_id=b5fdc6b9d489495d8752513fe21cdcd7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.449958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.461295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1152/2331] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:03 2022] PUT /identity/v3/projects/32f908c15b004911acc1caa1becf98ea/users/b5fdc6b9d489495d8752513fe21cdcd7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:03.472530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.472851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.473145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.505388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] MFA Rules not processed for user `b5fdc6b9d489495d8752513fe21cdcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:03.507657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:03.592255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1180/2332] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:03.603855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:03.607464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:03.668314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706e25-ec49-4b3e-a95c-76a1e8edce2d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:03.672109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:03.672753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:03.673032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:03.673298 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:03.683310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:03.684769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ab44b-02e0-4b5e-853b-ae49646c0e3b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:03.693907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1153/2333] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:04.129925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:04.189392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:04.201803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc59aa-d138-4bce-abb5-4d8293898cd6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:04.206436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:04.207082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:04.207363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:04.207640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] PATH_INFO: `/v3/users/0c3f8d765991411093ef9dac8d3aac03` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:04.208829 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3f8d765991411093ef9dac8d3aac03)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:04.211285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:04.263867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3f8d765991411093ef9dac8d3aac03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.264529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3f8d765991411093ef9dac8d3aac03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.272766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3f8d765991411093ef9dac8d3aac03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.286282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3f8d765991411093ef9dac8d3aac03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.287001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3f8d765991411093ef9dac8d3aac03'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.301050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1181/2334] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:04 2022] DELETE /identity/v3/users/0c3f8d765991411093ef9dac8d3aac03 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:04.306684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:04.307034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:04.307410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:04.332359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:04.333525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:04.395279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1154/2335] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:04.405695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:04.407202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:04.464981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b930bd9-5b9c-471c-9de8-c9fb386fade2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:04.468783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:04.469387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:04.469660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:04.469956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:04.479869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:04.481315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:04.490935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1182/2336] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:04.789092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:04.790969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:04.804700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed169a73-f0a2-47a2-98b4-fa99acd96992 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:04.810810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:04.811848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:04.812249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:04.812666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] PATH_INFO: `/v3/projects/097af989dd3b42ca8aa8d25ed00e0291` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:04.813830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] RBAC: Authorizing `identity:delete_project(project_id=097af989dd3b42ca8aa8d25ed00e0291)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:04.826646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:04.879756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097af989dd3b42ca8aa8d25ed00e0291', 'request_id': 'req-2b58060c-a7f9-469e-ba8f-e7da869e03de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.887218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097af989dd3b42ca8aa8d25ed00e0291', 'request_id': 'req-2b58060c-a7f9-469e-ba8f-e7da869e03de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.893792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097af989dd3b42ca8aa8d25ed00e0291', 'request_id': 'req-2b58060c-a7f9-469e-ba8f-e7da869e03de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.906951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] The token cache is being invalidate because project 097af989dd3b42ca8aa8d25ed00e0291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:04.907242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.907910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:04.909835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1155/2337] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:04 2022] DELETE /identity/v3/projects/097af989dd3b42ca8aa8d25ed00e0291 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:04.915712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:04.925661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199acb-0b31-4ea1-ab24-56bfbb7bcfa8 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:04.987250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:04.987880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:04.988159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:04.988455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] PATH_INFO: `/v3/users/b5fdc6b9d489495d8752513fe21cdcd7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:04.989626 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fdc6b9d489495d8752513fe21cdcd7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:04.991837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.009871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:05.043791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fdc6b9d489495d8752513fe21cdcd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.044443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fdc6b9d489495d8752513fe21cdcd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.051770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fdc6b9d489495d8752513fe21cdcd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.064244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fdc6b9d489495d8752513fe21cdcd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.065139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c17a805e-de4c-416e-b355-2e5e01c1dfa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fdc6b9d489495d8752513fe21cdcd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.080268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1183/2338] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:04 2022] DELETE /identity/v3/users/b5fdc6b9d489495d8752513fe21cdcd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:05.360508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.362277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:05.375653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58060c-a7f9-469e-ba8f-e7da869e03de admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.396037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:05.451439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.451994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.452277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.452548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] PATH_INFO: `/v3/projects/32f908c15b004911acc1caa1becf98ea` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.453729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f908c15b004911acc1caa1becf98ea)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.455636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.503797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f908c15b004911acc1caa1becf98ea', 'request_id': 'req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.511710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f908c15b004911acc1caa1becf98ea', 'request_id': 'req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.524058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f908c15b004911acc1caa1becf98ea', 'request_id': 'req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.534291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] The token cache is being invalidate because project 32f908c15b004911acc1caa1becf98ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:05.534573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.535232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cf369cb-2e56-43a6-8cde-f3656e9e52c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:05.540540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1156/2339] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:05 2022] DELETE /identity/v3/projects/32f908c15b004911acc1caa1becf98ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:05.542525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.542990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.543081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.562763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:05.564011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:05.623438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1184/2340] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:05.632139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.632430 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.633059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.654486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:05.655699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:05.663983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1157/2341] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:05.668289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.678923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28d738-da96-48a4-93be-b02b099190fc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.683606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.684193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.684465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.684763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.685416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:05.685690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.687249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.700526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1185/2342] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:27:05.704912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.714563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa127c0a-4231-49d1-a45d-90cc4a7b36d8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.719976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.720619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.720904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.721176 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.721809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.723751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.753169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1158/2343] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:05 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:05.757878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.767664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb40ef-e4a0-472f-bf84-496f4e544cae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.825488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.826459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.826939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.827399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.828045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.829990 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.863047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1186/2344] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:05 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:05.864288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.876075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a99d7-0775-4d22-ad8b-8454ce40b24f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.882916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.883791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.884208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.884678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.885584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.887632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.904154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1159/2345] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:05.908033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.919472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7bf51-bbe9-47a5-ae66-ca109bfda6bf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.924267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.924983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.925329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.925666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.926376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.928301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2b9ba-7284-48ae-a792-85186fd564dd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:05.939094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:05.950216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1187/2346] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:05.951060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:05.963501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0923057-ad6a-4f64-9c87-0f9da9832721 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:05.968335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:05.969089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:05.969368 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:05.969636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] PATH_INFO: `/v3/projects/6d6632839b4645f9a07810921e16f691/users/7dc40908cc20474c935d54256c1ff3c4/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:05.985120 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6632839b4645f9a07810921e16f691, user_id=7dc40908cc20474c935d54256c1ff3c4, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:05.987790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.002552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1160/2347] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:05 2022] PUT /identity/v3/projects/6d6632839b4645f9a07810921e16f691/users/7dc40908cc20474c935d54256c1ff3c4/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:06.014763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8b33e-e678-403c-b284-080fa190455b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.015569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8b33e-e678-403c-b284-080fa190455b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.015569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8b33e-e678-403c-b284-080fa190455b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.048717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-70f8b33e-e678-403c-b284-080fa190455b None None] MFA Rules not processed for user `7dc40908cc20474c935d54256c1ff3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:06.049977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-70f8b33e-e678-403c-b284-080fa190455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.114467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1188/2348] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:06.119348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.162637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:06.195752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9785-ca30-4039-8d0b-476e6aa181f6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.200441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.201076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.201383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.201649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.202271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.204207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.236154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1161/2349] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:06 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:06.240453 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8b33e-e678-403c-b284-080fa190455b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.251576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8b33e-e678-403c-b284-080fa190455b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.309203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.309827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.310105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.310374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.311114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.313089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.337812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1189/2350] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:06 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:06.341291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.341660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.343002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.351573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69e4a-761e-41ba-adc1-376418ef86da admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.356493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.357272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.357553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.358014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.358653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.361655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.371703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1190/2351] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:06.375683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.386398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e3594-f365-435f-9ec3-62c122164b4e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.391024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.391656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.391932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.392204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] PATH_INFO: `/v3/projects/ff547a0c3fb247549c59b5deeaa87817/users/48f3fe18571847ed82c96d3c098cfacd/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.408345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff547a0c3fb247549c59b5deeaa87817, user_id=48f3fe18571847ed82c96d3c098cfacd, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.411366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31b530-da40-4e6f-ba0e-7d7b958404a1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.413939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.415381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.416164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.416519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.416907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.418832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.431049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1191/2352] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:06 2022] PUT /identity/v3/projects/ff547a0c3fb247549c59b5deeaa87817/users/48f3fe18571847ed82c96d3c098cfacd/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:06.434913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.486449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:06.493105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.494918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.504334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1162/2353] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:06.504867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e715e-0803-47cb-ba0d-42b37e2d1730 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.510356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.510971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.511248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.511544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.512323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.513944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce063efe-a645-44ab-90cc-a5c3fc3a1cc3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.528984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1192/2354] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:06.530269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.542405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd924-629c-4c6d-af03-a48d920ff5d8 service glance] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.547263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.547935 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.548334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.548642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] PATH_INFO: `/v3/projects/ff547a0c3fb247549c59b5deeaa87817/users/48f3fe18571847ed82c96d3c098cfacd/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.550582 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff547a0c3fb247549c59b5deeaa87817, user_id=48f3fe18571847ed82c96d3c098cfacd, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.553328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.570055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1163/2355] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:06 2022] PUT /identity/v3/projects/ff547a0c3fb247549c59b5deeaa87817/users/48f3fe18571847ed82c96d3c098cfacd/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:06.580465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afce82-6eec-4f6e-9c20-fd11fa1727d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.580988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afce82-6eec-4f6e-9c20-fd11fa1727d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.581330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afce82-6eec-4f6e-9c20-fd11fa1727d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.619347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-17afce82-6eec-4f6e-9c20-fd11fa1727d3 None None] MFA Rules not processed for user `48f3fe18571847ed82c96d3c098cfacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:06.620856 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-17afce82-6eec-4f6e-9c20-fd11fa1727d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.705954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1193/2356] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:06.762614 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.765007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.775564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186900-4729-4534-b1c8-ad56aa512fa7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.776128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186900-4729-4534-b1c8-ad56aa512fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.776397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186900-4729-4534-b1c8-ad56aa512fa7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.778621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1194/2357] 10.222.0.71 () {54 vars in 912 bytes} [Mon Sep 19 11:27:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:27:06.785575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.785936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.786281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.820110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:06.822356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.842204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2202b6-16d4-4eb7-9f1c-2dcfe29a1049 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.846393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.847062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.847403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.847773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.859480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.861362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.874390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1164/2358] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:06.900218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1195/2359] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:06.921807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:06.923318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:06.936426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e3079-179c-4688-bd63-3231d3fc027d service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:06.941818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:06.942814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:06.943316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:06.943788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:06.949462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:06.954696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:06.957231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbb9dc-1885-44dc-b17e-40164810e724 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:06.969055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1165/2360] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:08.539178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:08.611064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5a167-70b3-4d75-a944-105dd3e61ce0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:08.615692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:08.616660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:08.616945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:08.617218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] PATH_INFO: `/v3/users/7dc40908cc20474c935d54256c1ff3c4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:08.618351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc40908cc20474c935d54256c1ff3c4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:08.620259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:08.638104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:08.674245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc40908cc20474c935d54256c1ff3c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:08.675148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc40908cc20474c935d54256c1ff3c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:08.696634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc40908cc20474c935d54256c1ff3c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:08.718758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc40908cc20474c935d54256c1ff3c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:08.719894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc40908cc20474c935d54256c1ff3c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:08.734119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1196/2361] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:08 2022] DELETE /identity/v3/users/7dc40908cc20474c935d54256c1ff3c4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:08.738746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:08.739318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:08.739318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:08.761442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:08.762669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:08.839420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1166/2362] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:08.852490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:08.854022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:08.925473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75891ca2-a149-4303-9b59-e25d3842547c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:08.930205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:08.930929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:08.931326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:08.931689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:08.942284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:08.944148 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:08.956333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1197/2363] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:09.247064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:09.248914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:09.262273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece664-f249-41e4-8460-4838b1c3317b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:09.270733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:09.271380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:09.272902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:09.273212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] PATH_INFO: `/v3/projects/6d6632839b4645f9a07810921e16f691` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:09.274461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6632839b4645f9a07810921e16f691)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:09.277268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:09.329880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6632839b4645f9a07810921e16f691', 'request_id': 'req-a097ab0c-28cf-4988-8ccd-90ded1726572'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.349144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6632839b4645f9a07810921e16f691', 'request_id': 'req-a097ab0c-28cf-4988-8ccd-90ded1726572'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.356485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6632839b4645f9a07810921e16f691', 'request_id': 'req-a097ab0c-28cf-4988-8ccd-90ded1726572'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.372219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] The token cache is being invalidate because project 6d6632839b4645f9a07810921e16f691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:09.372515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.373224 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.374737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1167/2364] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:09 2022] DELETE /identity/v3/projects/6d6632839b4645f9a07810921e16f691 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:09.378619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:09.388233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37ee8-ab8e-4bd4-95c8-481441e84a12 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:09.450260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:09.450885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:09.451161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:09.452002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] PATH_INFO: `/v3/users/48f3fe18571847ed82c96d3c098cfacd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:09.452611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f3fe18571847ed82c96d3c098cfacd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:09.454632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:09.505611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:09.518325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f3fe18571847ed82c96d3c098cfacd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.519116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f3fe18571847ed82c96d3c098cfacd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.529824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f3fe18571847ed82c96d3c098cfacd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.550516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f3fe18571847ed82c96d3c098cfacd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.551587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6092f45f-051c-442b-9896-75c3c90ac9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f3fe18571847ed82c96d3c098cfacd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:09.574940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1198/2365] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:09 2022] DELETE /identity/v3/users/48f3fe18571847ed82c96d3c098cfacd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:09.909774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:09.911733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:09.927735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ab0c-28cf-4988-8ccd-90ded1726572 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:09.997524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:09.998216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:09.998504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:09.998771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] PATH_INFO: `/v3/projects/ff547a0c3fb247549c59b5deeaa87817` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:09.999919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff547a0c3fb247549c59b5deeaa87817)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.001964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.025739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:10.057321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff547a0c3fb247549c59b5deeaa87817', 'request_id': 'req-b2d1c4be-eb20-44c9-a653-3c1c903770c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:10.073045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff547a0c3fb247549c59b5deeaa87817', 'request_id': 'req-b2d1c4be-eb20-44c9-a653-3c1c903770c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:10.080973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff547a0c3fb247549c59b5deeaa87817', 'request_id': 'req-b2d1c4be-eb20-44c9-a653-3c1c903770c6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:10.094172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] The token cache is being invalidate because project ff547a0c3fb247549c59b5deeaa87817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:10.094465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:10.095115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2d1c4be-eb20-44c9-a653-3c1c903770c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:10.096615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1168/2366] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:09 2022] DELETE /identity/v3/projects/ff547a0c3fb247549c59b5deeaa87817 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:10.101878 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.102255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.102579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.123242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:10.124605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:10.190917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1199/2367] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:10.201256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.201596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.201789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.224714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:10.226656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:10.235631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1169/2368] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:10.239866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.254690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cd435-745b-46cb-bc8b-47ba0c9434ea None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.262863 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.263474 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.263751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.264016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.264698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:10.265002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.266584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.281205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1200/2369] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:27:10.286286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.296043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921772c-fdbb-4871-a800-7ed109f7702e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.305350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.306059 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.306401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.306674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.307316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.309294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.338130 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1170/2370] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:10.342172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.354885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660de9f-7dc4-4e51-a0fe-2893c556f877 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.415326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.415940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.416225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.416496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.417160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.419294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.446429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1201/2371] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:10.447888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.458382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7048a-94c8-46a3-a13e-1f5bc7510839 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.467661 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.468332 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.468650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.468927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.469585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.471203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.482124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1171/2372] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:10.486332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.510284 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c730c3-e5e7-486f-8a33-4103f4017bc8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.515769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.516387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.516712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.516988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.517640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.519265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd40314-1a3c-439d-9d91-43f230818263 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.530669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1202/2373] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:10.534796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.546242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350751b-8b59-4602-8916-235aa4435ea1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.550922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.551567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.551843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.552115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] PATH_INFO: `/v3/projects/6e83b893149c4d2181bac7364fab142e/users/130b4a495aff4e8d8863b455480e0792/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.571032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83b893149c4d2181bac7364fab142e, user_id=130b4a495aff4e8d8863b455480e0792, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.573967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.589918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1172/2374] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:10 2022] PUT /identity/v3/projects/6e83b893149c4d2181bac7364fab142e/users/130b4a495aff4e8d8863b455480e0792/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:10.602251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.602777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.602777 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.632602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] MFA Rules not processed for user `130b4a495aff4e8d8863b455480e0792`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:10.633835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:10.643805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:10.729933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1203/2375] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:10.731147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.812893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6929-7dd3-4d89-8c80-4d312bae0187 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.817604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.818274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.818596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.819034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.819677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.821650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.854626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1173/2376] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:10.856056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.867312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c47b5-b08d-41d1-a30d-d4b0a56b7d57 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.940041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.940820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.941232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.941631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.942391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:10.944825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:10.974916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1204/2377] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:10 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:10.977257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:10.988199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd2d4-b824-4a10-85ad-b53d805a86ab admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:10.995939 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:10.996888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:10.997800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:10.998078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:10.998731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.002172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.016638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1174/2378] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:11.021261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.035146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfe41f-855c-4e40-95b6-f3dbd0e80b73 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.046334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.047157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.047540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.048429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] PATH_INFO: `/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5/users/141b4b6b23b44827b4d22b5b34a220db/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.066018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1c62d137c4eafb7fe9bae2f7982d5, user_id=141b4b6b23b44827b4d22b5b34a220db, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.069115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.083771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1205/2379] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:11 2022] PUT /identity/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5/users/141b4b6b23b44827b4d22b5b34a220db/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:11.088560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.102742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dc0bc-401d-4daa-8b50-8bfbc93d3d80 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.118818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:11.177559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.178172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.178453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.178825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.179405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.180982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c618cc-5020-4baf-930f-006a7e9cb16a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.195602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1175/2380] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:11.199828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.212411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2793f8-1618-4558-8b93-59a5f365a013 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.217945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.218690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.219084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.219368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] PATH_INFO: `/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5/users/141b4b6b23b44827b4d22b5b34a220db/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.221366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1c62d137c4eafb7fe9bae2f7982d5, user_id=141b4b6b23b44827b4d22b5b34a220db, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.224034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.240760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1206/2381] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:11 2022] PUT /identity/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5/users/141b4b6b23b44827b4d22b5b34a220db/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:11.258023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.258342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.258575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.288723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] MFA Rules not processed for user `141b4b6b23b44827b4d22b5b34a220db`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:11.290035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:11.397269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1176/2382] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:11.410865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.412654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:11.476024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3bdb7-6767-4678-82d7-29a03db8d9a8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.479764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.480364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.480671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.480942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.490084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.492046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.502026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1207/2383] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:11.854180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.864090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da8e9-2f2c-454e-891d-65849d5e2fc0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.869710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '141b4b6b23b44827b4d22b5b34a220db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1c62d137c4eafb7fe9bae2f7982d5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.870318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.870599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.870879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.871515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:11.871817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.873452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.888087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1177/2384] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:11.892523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.907800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6d2d-bb2f-4a2c-a60a-93d2cbf24833 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:11.912881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '141b4b6b23b44827b4d22b5b34a220db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1c62d137c4eafb7fe9bae2f7982d5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:11.917131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:11.917419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:11.917695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:11.922801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:11.922801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:11.928101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:11.956110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1208/2385] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:11 2022] POST /identity/v3/projects => generated 354 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:11.957634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:11.967605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d9537-e5bd-4821-b780-76efd9fdc95b tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:12.024097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '141b4b6b23b44827b4d22b5b34a220db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1c62d137c4eafb7fe9bae2f7982d5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:12.024800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:12.024898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:12.025162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:12.025811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:12.026112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:12.027704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:12.040188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1178/2386] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:12.084553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:12.095448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b8b84-05c9-441e-8d24-fa6d20b0d4af tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:12.100004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '141b4b6b23b44827b4d22b5b34a220db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1c62d137c4eafb7fe9bae2f7982d5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:12.101220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:12.101507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:12.101772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] PATH_INFO: `/v3/projects/adc6de0002bc47a1a7cf4fcd8d273eab` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:12.102872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adc6de0002bc47a1a7cf4fcd8d273eab)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:12.104762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:12.151072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc6de0002bc47a1a7cf4fcd8d273eab', 'request_id': 'req-424c9998-f5d2-467c-961b-70e57f1c9d68'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.157094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc6de0002bc47a1a7cf4fcd8d273eab', 'request_id': 'req-424c9998-f5d2-467c-961b-70e57f1c9d68'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.163355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc6de0002bc47a1a7cf4fcd8d273eab', 'request_id': 'req-424c9998-f5d2-467c-961b-70e57f1c9d68'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.177562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] The token cache is being invalidate because project adc6de0002bc47a1a7cf4fcd8d273eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:12.177847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.179091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-424c9998-f5d2-467c-961b-70e57f1c9d68 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.180787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1209/2387] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:12 2022] DELETE /identity/v3/projects/adc6de0002bc47a1a7cf4fcd8d273eab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:12.376187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:12.377988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:12.403150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:12.477834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a967d3-4b70-4c80-bafb-ac7273f0dcf3 tempest-VolumeQuotaClassesTest-1119040898 tempest-VolumeQuotaClassesTest-1119040898-project-admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:12.541908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:12.542549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:12.542828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:12.543099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] PATH_INFO: `/v3/users/130b4a495aff4e8d8863b455480e0792` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:12.544236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130b4a495aff4e8d8863b455480e0792)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:12.546207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:12.608644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130b4a495aff4e8d8863b455480e0792'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.615563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130b4a495aff4e8d8863b455480e0792'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.640229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130b4a495aff4e8d8863b455480e0792'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.640989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130b4a495aff4e8d8863b455480e0792'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.641601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130b4a495aff4e8d8863b455480e0792'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:12.655554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1179/2388] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:12 2022] DELETE /identity/v3/users/130b4a495aff4e8d8863b455480e0792 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:12.660010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:12.660291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:12.660561 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:12.680398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:12.681636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:12.751257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1210/2389] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:12.761037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:12.762490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:12.818334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:12.825326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900d0b-e6f1-42ab-a2aa-2bcd1ba97541 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:12.829931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:12.830585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:12.831033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:12.831502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:12.846550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:12.848066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:12.857668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1180/2390] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:13.140332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:13.142294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:13.156025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cbe8f-0bb5-4d7d-9bb0-394bb6750136 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:13.161027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:13.161645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:13.162084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:13.162356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] PATH_INFO: `/v3/projects/6e83b893149c4d2181bac7364fab142e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:13.163701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83b893149c4d2181bac7364fab142e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:13.165627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:13.215928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83b893149c4d2181bac7364fab142e', 'request_id': 'req-94aa8b16-1aa1-4386-9420-70ed119aba9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.222332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83b893149c4d2181bac7364fab142e', 'request_id': 'req-94aa8b16-1aa1-4386-9420-70ed119aba9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.228536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83b893149c4d2181bac7364fab142e', 'request_id': 'req-94aa8b16-1aa1-4386-9420-70ed119aba9d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.232625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:13.243211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] The token cache is being invalidate because project 6e83b893149c4d2181bac7364fab142e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:13.244006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.245001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.246734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1211/2391] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:13 2022] DELETE /identity/v3/projects/6e83b893149c4d2181bac7364fab142e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:13.250904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:13.263172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a258b5c-5ce4-4d02-8e76-cffa50d04d08 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:13.324185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:13.325078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:13.326576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:13.326576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] PATH_INFO: `/v3/users/141b4b6b23b44827b4d22b5b34a220db` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:13.327012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141b4b6b23b44827b4d22b5b34a220db)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:13.328981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:13.378454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141b4b6b23b44827b4d22b5b34a220db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.385634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141b4b6b23b44827b4d22b5b34a220db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.398160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141b4b6b23b44827b4d22b5b34a220db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.398856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141b4b6b23b44827b4d22b5b34a220db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.399933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-acc5b3f8-3f4a-4f4e-8b9e-665002eb4111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141b4b6b23b44827b4d22b5b34a220db'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.414374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1181/2392] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:13 2022] DELETE /identity/v3/users/141b4b6b23b44827b4d22b5b34a220db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:13.714907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:13.717079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:13.758968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8b16-1aa1-4386-9420-70ed119aba9d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:13.822365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:13.822999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:13.823277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:13.823549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] PATH_INFO: `/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:13.824690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a1c62d137c4eafb7fe9bae2f7982d5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:13.826608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:13.891494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a1c62d137c4eafb7fe9bae2f7982d5', 'request_id': 'req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.909962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a1c62d137c4eafb7fe9bae2f7982d5', 'request_id': 'req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.916105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a1c62d137c4eafb7fe9bae2f7982d5', 'request_id': 'req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.929450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] The token cache is being invalidate because project 15a1c62d137c4eafb7fe9bae2f7982d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:13.929450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.930093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8dd14c0f-64a5-4d9a-888c-70f3dd5d6621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:13.931600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1212/2393] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:13 2022] DELETE /identity/v3/projects/15a1c62d137c4eafb7fe9bae2f7982d5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:13.936467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:13.936820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:13.937092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:13.958236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:13.959466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:14.025313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1182/2394] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:14.033484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef204-738b-4623-9057-f7cb5370944b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.033834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef204-738b-4623-9057-f7cb5370944b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.034279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef204-738b-4623-9057-f7cb5370944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.057615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-92aef204-738b-4623-9057-f7cb5370944b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:14.059126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92aef204-738b-4623-9057-f7cb5370944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:14.067885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1213/2395] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:14.073404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.083154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d9c03-6d18-4f77-b09c-dd2d4b17ebb1 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.087723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.088310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.088618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.088880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.089516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:14.089813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.091402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.093852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:14.104732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1183/2396] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:14.108828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef204-738b-4623-9057-f7cb5370944b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.119629 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef204-738b-4623-9057-f7cb5370944b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.124302 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.124920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.125198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.125466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.126096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.127965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.155012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1214/2397] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:14.159417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.169926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e1d8-9930-4c2f-a97d-6f316173db6b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.230165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.230766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.231041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.231307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.231934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.233855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.255722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1184/2398] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:14.260505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.270742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd3366-f314-4e7e-8f2e-b3cc550a84c1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.275694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.276289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.276567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.276860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.277525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.279100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.289854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1215/2399] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:14.293858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.304564 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c5ef5-59ed-4768-ac81-1ae31700bca8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.309235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.309822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.310106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.310377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.311021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.312634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312910a-f385-45d8-9685-284333d70812 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.323416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1185/2400] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:14.327444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.337674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebabd7-868a-4127-90b3-1f863f586672 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.342215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.342848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.343126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.343398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] PATH_INFO: `/v3/projects/ffffde89dedb44f9b3dde2d1b90193aa/users/d4793b50ce0c49d5991114b367c84729/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.362436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffffde89dedb44f9b3dde2d1b90193aa, user_id=d4793b50ce0c49d5991114b367c84729, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.365084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.382611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1216/2401] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:14 2022] PUT /identity/v3/projects/ffffde89dedb44f9b3dde2d1b90193aa/users/d4793b50ce0c49d5991114b367c84729/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:14.393707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.393993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.394300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.422807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] MFA Rules not processed for user `d4793b50ce0c49d5991114b367c84729`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:14.424020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:14.494329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1186/2402] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:14.498808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.519042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:14.568256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1179b-5105-444d-a999-2fb1e762401b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.573241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.573847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.574126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.574418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.575071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.577191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.603819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1217/2403] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:14.607837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.619244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c9fda-8e91-4688-b7cd-53128ce90fcc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.680198 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.680848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.681159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.681409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.682042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.683955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.694292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:14.715102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1187/2404] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:14.718341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.737574 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95669ebb-f9e3-4684-aa2c-a0393bdd189a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.743497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.744142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.744419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.744735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.745385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.746989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.765619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1218/2405] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:14.770559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.783615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103b03d-7aaa-41d1-a8a4-c013571de345 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.789033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.789677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.789978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.790247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] PATH_INFO: `/v3/projects/7158d70f9a8c4a4fa7e37719353ca633/users/01a362e1946f45179d9e45965625af85/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.805382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7158d70f9a8c4a4fa7e37719353ca633, user_id=01a362e1946f45179d9e45965625af85, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.808013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.821382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1188/2406] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:14 2022] PUT /identity/v3/projects/7158d70f9a8c4a4fa7e37719353ca633/users/01a362e1946f45179d9e45965625af85/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:14.825891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.836176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c0e1-a28f-4337-bbac-cc8c23b91731 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.899784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.900402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.900717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.901041 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.901696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.903377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ef14-804c-4acf-b549-200ca3c1237f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.915695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1219/2407] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:14.920155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:14.932839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e57bc-bc7d-4847-9b2c-c3fec1a4ca6d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:14.938331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:14.939121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.939499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.939872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] PATH_INFO: `/v3/projects/7158d70f9a8c4a4fa7e37719353ca633/users/01a362e1946f45179d9e45965625af85/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:14.942522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7158d70f9a8c4a4fa7e37719353ca633, user_id=01a362e1946f45179d9e45965625af85, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:14.946819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:14.958994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1189/2408] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:14 2022] PUT /identity/v3/projects/7158d70f9a8c4a4fa7e37719353ca633/users/01a362e1946f45179d9e45965625af85/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:14.970259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:14.970544 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:14.970816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:15.001902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] MFA Rules not processed for user `01a362e1946f45179d9e45965625af85`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:15.003231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:15.076437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1220/2409] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:15.089283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:15.091181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:15.154613 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb8fe3-d22d-4500-ae96-8ce2709e3f73 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:15.158318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:15.158947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:15.159228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:15.159498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:15.169021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:15.170458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:15.180432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1190/2410] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:15.236143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:15.237528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:15.250580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e69340-aa4e-4f31-8fa1-dde38417847f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:15.254200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:15.254831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:15.255109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:15.255376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:15.265768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:15.314592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:15.316010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be874a-872d-482e-8d44-8cc5328012b8 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:15.324805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1221/2411] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:19.733925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:19.805598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108e09-d830-4447-9386-1ddfd4a9eade service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:19.816429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:19.816429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:19.816429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:19.816429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] PATH_INFO: `/v3/users/d4793b50ce0c49d5991114b367c84729` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:19.817028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4793b50ce0c49d5991114b367c84729)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:19.817028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:19.890952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4793b50ce0c49d5991114b367c84729'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:19.901099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4793b50ce0c49d5991114b367c84729'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:19.908169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:19.919831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4793b50ce0c49d5991114b367c84729'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:19.920988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4793b50ce0c49d5991114b367c84729'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:19.921773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4793b50ce0c49d5991114b367c84729'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:19.937147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1191/2412] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:19 2022] DELETE /identity/v3/users/d4793b50ce0c49d5991114b367c84729 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:19.941663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:19.942187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:19.942281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:19.962283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:19.963511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:20.031621 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1222/2413] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:20.041548 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:20.042991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:20.110244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266e13-53ea-4656-90e6-c320428aa6e6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:20.122740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:20.123388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:20.123665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:20.123931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:20.135674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:20.137685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:20.148033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1192/2414] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:20.435843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:20.438378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:20.452696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd9625-5bb4-4050-b380-ad8c2ef34504 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:20.457938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:20.458831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:20.459174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:20.460228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] PATH_INFO: `/v3/projects/ffffde89dedb44f9b3dde2d1b90193aa` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:20.462096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffffde89dedb44f9b3dde2d1b90193aa)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:20.463657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:20.512287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffffde89dedb44f9b3dde2d1b90193aa', 'request_id': 'req-39ce5991-3ad4-45b5-80a0-63c470d0e289'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.518966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffffde89dedb44f9b3dde2d1b90193aa', 'request_id': 'req-39ce5991-3ad4-45b5-80a0-63c470d0e289'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.525995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffffde89dedb44f9b3dde2d1b90193aa', 'request_id': 'req-39ce5991-3ad4-45b5-80a0-63c470d0e289'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.538153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] The token cache is being invalidate because project ffffde89dedb44f9b3dde2d1b90193aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:20.538429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.539085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.540844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1223/2415] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:20 2022] DELETE /identity/v3/projects/ffffde89dedb44f9b3dde2d1b90193aa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:20.544848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:20.554509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef153b-2278-423c-8e61-6ba5326c80dc service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:20.613660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:20.614282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:20.614559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:20.614827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] PATH_INFO: `/v3/users/01a362e1946f45179d9e45965625af85` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:20.615978 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a362e1946f45179d9e45965625af85)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:20.618187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:20.664409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a362e1946f45179d9e45965625af85'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.671181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a362e1946f45179d9e45965625af85'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.684146 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a362e1946f45179d9e45965625af85'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.685015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a362e1946f45179d9e45965625af85'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.685666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-f793ee9e-fd85-4b7d-ac99-ddf2d3282570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a362e1946f45179d9e45965625af85'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:20.697616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:20.702783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1193/2416] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:20 2022] DELETE /identity/v3/users/01a362e1946f45179d9e45965625af85 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:20.976551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:20.978538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:20.992828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5991-3ad4-45b5-80a0-63c470d0e289 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.028762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:21.057540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.058126 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.058404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.058692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] PATH_INFO: `/v3/projects/7158d70f9a8c4a4fa7e37719353ca633` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.059814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7158d70f9a8c4a4fa7e37719353ca633)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.061767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.108466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7158d70f9a8c4a4fa7e37719353ca633', 'request_id': 'req-77d947a5-391c-4982-9aa4-60002c745f91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:21.114539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7158d70f9a8c4a4fa7e37719353ca633', 'request_id': 'req-77d947a5-391c-4982-9aa4-60002c745f91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:21.120489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7158d70f9a8c4a4fa7e37719353ca633', 'request_id': 'req-77d947a5-391c-4982-9aa4-60002c745f91'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:21.134512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] The token cache is being invalidate because project 7158d70f9a8c4a4fa7e37719353ca633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:21.134870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:21.135591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-77d947a5-391c-4982-9aa4-60002c745f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:21.137263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1224/2417] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:20 2022] DELETE /identity/v3/projects/7158d70f9a8c4a4fa7e37719353ca633 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:21.142728 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.143276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.143843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.173032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:21.174404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:21.247283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1194/2418] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:21.256343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.257361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.257919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.279357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:21.280739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:21.292735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1225/2419] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:21.294303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.305077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a17f8-49b6-45b6-96ab-d13ff72f5dd0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.311518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.312138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.312420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.312722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.313374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:21.313791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.315260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.335895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1195/2420] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:21.336541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.346113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0386c1-5497-43d6-a7ac-373a727831fc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.353120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.353893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.354336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.354756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.355522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.357635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.411036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1226/2421] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:21.413492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.423482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2c6be-af43-4299-9e02-39f870de918d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.484769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.486227 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.486499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.486764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.487383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.489330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.512351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1196/2422] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:21 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:21.516350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.527566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e080-5873-46cf-a370-505ea1fed97b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.532169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.532800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.533079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.533348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.533989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.535575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.546467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1227/2423] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:21.550681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.560897 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c64ce-d171-442f-bfe5-65f64bcb529a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.565697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.566297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.566572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.566839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.567480 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.569134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dfc38-319f-42d4-bcc0-a98732a27f02 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.583426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1197/2424] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:21.584321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.595374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad8e2-2185-4503-8db5-ed3f5584b75e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.600110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.602040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.602319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.602589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] PATH_INFO: `/v3/projects/02e3bd84437342a8ae06d9d9379fcd0c/users/b388de2d6c594546b2f04caf1e29c9bf/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.617880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e3bd84437342a8ae06d9d9379fcd0c, user_id=b388de2d6c594546b2f04caf1e29c9bf, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.620492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.633047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1228/2425] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:21 2022] PUT /identity/v3/projects/02e3bd84437342a8ae06d9d9379fcd0c/users/b388de2d6c594546b2f04caf1e29c9bf/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:21.638012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ebd-8bc5-496c-b796-1ab77e61d29b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.638297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ebd-8bc5-496c-b796-1ab77e61d29b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.638569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ebd-8bc5-496c-b796-1ab77e61d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.658291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-406e9ebd-8bc5-496c-b796-1ab77e61d29b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:21.659630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-406e9ebd-8bc5-496c-b796-1ab77e61d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:21.717749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1198/2426] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:21.727822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:21.729505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:21.787296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d517a-26ce-444f-a937-93363534c212 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:21.792227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:21.792867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:21.793145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:21.793415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:21.802506 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:21.804114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:21.813545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1229/2427] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:22.496011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.496488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.496709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.515775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:22.536068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] MFA Rules not processed for user `b388de2d6c594546b2f04caf1e29c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:22.538247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:22.612093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1199/2428] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:22.614186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:22.624694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:22.629291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9b63-bcd6-489a-8493-3c40b45dbe90 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:22.638482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:22.640217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.641383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.643591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.644744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:22.646965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:22.720355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1230/2429] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:22.723478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:22.734722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ebd55-cfd1-4dff-8359-c169156883c4 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:22.792288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:22.792934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.793213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.793482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.794109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:22.796011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:22.816810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1200/2430] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:22 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:22.821697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:22.831654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba1f07-dae6-4ad8-8be8-10a84af28943 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:22.837169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:22.837764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.838043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.838317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.838958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:22.840538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:22.855232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1231/2431] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:22.859573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:22.870233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b65d8-044d-4bb2-84ac-fe1b46495596 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:22.874910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:22.875573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.875840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.876112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] PATH_INFO: `/v3/projects/016e042602e447f08088207487f1ef58/users/52b9356d16e04c74a27761b747009ea9/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.891345 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=016e042602e447f08088207487f1ef58, user_id=52b9356d16e04c74a27761b747009ea9, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:22.894119 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:22.908253 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1201/2432] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:22 2022] PUT /identity/v3/projects/016e042602e447f08088207487f1ef58/users/52b9356d16e04c74a27761b747009ea9/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:22.912230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:22.923798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30cff9-89ee-4982-afe8-ec0d1cf394f4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:22.989916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:22.990532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:22.991331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:22.991887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:22.992530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:22.994185 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131147a1-5b9e-446e-9831-2e78bf7179ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:23.004859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1232/2433] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:23.009495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:23.019785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74d05-5482-4e83-b491-49cf0a64a38d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:23.025126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:23.025814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:23.026097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:23.026370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] PATH_INFO: `/v3/projects/016e042602e447f08088207487f1ef58/users/52b9356d16e04c74a27761b747009ea9/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:23.028357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=016e042602e447f08088207487f1ef58, user_id=52b9356d16e04c74a27761b747009ea9, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:23.031366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc04b-7106-4856-a94e-d0580ed99acd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:23.042338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1202/2434] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:23 2022] PUT /identity/v3/projects/016e042602e447f08088207487f1ef58/users/52b9356d16e04c74a27761b747009ea9/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:23.675003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:23.675487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:23.675487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:23.709052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] MFA Rules not processed for user `52b9356d16e04c74a27761b747009ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:23.710535 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:23.804030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1233/2435] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:23.815277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:23.815876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:23.815876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:23.844175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] MFA Rules not processed for user `b388de2d6c594546b2f04caf1e29c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:23.845441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:23.902238 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:23.925316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1203/2436] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:24.020855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:24.023200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:24.088952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:24.111665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a8e9-7b2b-46ef-b7b3-7c06bbebb2e9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:24.119422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:24.120035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:24.120310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:24.120612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:24.130100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:24.131963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2286-49ce-4b71-874f-8c7a6e5e7a03 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:24.142401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1234/2437] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:32.877518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:32.879047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:32.951472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b05207-7f7a-4fac-802d-1f845a5c009d None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:32.956970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:32.957718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:32.957976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:32.958252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] PATH_INFO: `/v3/users/6680f5a67b0140eda7b5653736e82ed5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:32.959438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6680f5a67b0140eda7b5653736e82ed5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:32.961532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.009000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6680f5a67b0140eda7b5653736e82ed5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.015950 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6680f5a67b0140eda7b5653736e82ed5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.027790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6680f5a67b0140eda7b5653736e82ed5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.028464 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6680f5a67b0140eda7b5653736e82ed5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.029098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6680f5a67b0140eda7b5653736e82ed5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.042064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1204/2438] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:32 2022] DELETE /identity/v3/users/6680f5a67b0140eda7b5653736e82ed5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:33.046502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.046966 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.047079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.066926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:33.068166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:33.130688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1235/2439] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:33.141054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:33.142477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:33.206201 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033b1e6-955d-4e12-8d5b-0025bbbdea05 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:33.209928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:33.211267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.211496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.211759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.221306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:33.222745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe285f-698d-4c19-a9cf-4db147b05a0a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.233632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1205/2440] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:33.520022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:33.521522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:33.536854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1154-c295-412c-87b8-0f3292b64927 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:33.542141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:33.542763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.543039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.543309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] PATH_INFO: `/v3/projects/ea8fb8614027430fbd6c67736c54bf96` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.544418 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8fb8614027430fbd6c67736c54bf96)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:33.546350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.592834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8fb8614027430fbd6c67736c54bf96', 'request_id': 'req-87e4183a-62f7-4649-bda7-b67aadd6ce66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.598984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8fb8614027430fbd6c67736c54bf96', 'request_id': 'req-87e4183a-62f7-4649-bda7-b67aadd6ce66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.605677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8fb8614027430fbd6c67736c54bf96', 'request_id': 'req-87e4183a-62f7-4649-bda7-b67aadd6ce66'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.618684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] The token cache is being invalidate because project ea8fb8614027430fbd6c67736c54bf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:33.618972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.619613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87e4183a-62f7-4649-bda7-b67aadd6ce66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:33.621169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1236/2441] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:33 2022] DELETE /identity/v3/projects/ea8fb8614027430fbd6c67736c54bf96 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:33.626127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.626415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.626691 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.646664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:33.648320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:33.659402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:33.727900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1206/2442] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:33.736826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.737097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.737378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.758030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:33.759324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:33.767772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1237/2443] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:33.772477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:33.786259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f4f63-0699-40a9-8dd3-ba3b5b44042b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:33.793256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:33.793892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.794174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.794565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.795245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:33.795550 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:33.797630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.811503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1207/2444] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:27:33.815868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:33.825515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e0252-e77b-44a8-8ada-a1ef15197552 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:33.830492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:33.831080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.831350 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.831656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.832230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:33.834124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.866590 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1238/2445] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:33 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:27:33.871300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:33.885652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d606-f504-47a1-a772-30fa8b23091e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:33.953209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:33.953829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:33.954197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:33.956011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:33.956011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:33.957418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:33.981161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1208/2446] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:33 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:33.991378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:34.003715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daea06-3a3b-4924-8995-77c6cadb6f01 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:34.012274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:34.013203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:34.013602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:34.013875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:34.014713 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:34.016394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:34.032673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1239/2447] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:34.041532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:34.055954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619034c5-0aaa-42e2-a905-7d15ad885a9c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:34.065251 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:34.066086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:34.066640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:34.066922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:34.067567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:34.069361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4586-748a-49c6-9aef-ec91b44b06e1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:34.084749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1209/2448] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:27:34.086608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:34.096906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff46a6-be92-47c3-a935-a41a7277381d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:34.103085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:34.105157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:34.105503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:34.105751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] PATH_INFO: `/v3/projects/489d5600624b4e67a13e48dcc5b05697/users/8e594b27a11e4533a8c6dbfb16f00b99/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:34.123373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489d5600624b4e67a13e48dcc5b05697, user_id=8e594b27a11e4533a8c6dbfb16f00b99, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:34.126251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:34.141844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:34.149258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1240/2449] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:34 2022] PUT /identity/v3/projects/489d5600624b4e67a13e48dcc5b05697/users/8e594b27a11e4533a8c6dbfb16f00b99/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:34.160319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588eb1e-aa91-49f0-a504-f3504fb61544 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:34.160640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588eb1e-aa91-49f0-a504-f3504fb61544 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:34.160918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588eb1e-aa91-49f0-a504-f3504fb61544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:34.193340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b588eb1e-aa91-49f0-a504-f3504fb61544 None None] MFA Rules not processed for user `8e594b27a11e4533a8c6dbfb16f00b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:34.195380 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b588eb1e-aa91-49f0-a504-f3504fb61544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:34.263727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1210/2450] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:34.275910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:34.277783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:34.337476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4eb9c-2ec6-4dca-9a3e-c8a846e57566 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:34.341109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:34.341703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:34.341977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:34.342291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:34.351052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:34.353211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:34.362935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1241/2451] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:37.118135 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294c03-82f7-4d67-a052-8c67876f372f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:37.118617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294c03-82f7-4d67-a052-8c67876f372f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:37.118762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294c03-82f7-4d67-a052-8c67876f372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:37.147355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c6294c03-82f7-4d67-a052-8c67876f372f None None] MFA Rules not processed for user `e8257392699b493cbecd42ceb62ddff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:37.149886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c6294c03-82f7-4d67-a052-8c67876f372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:37.156466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:37.233723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1211/2452] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:38.714662 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:38.716834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:38.792220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1578-5616-4a3d-a180-b4647bc6af9e service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:38.798592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:38.799620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:38.799620 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:38.800189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] PATH_INFO: `/v3/users/3f6df1526de84b369b7233dce0021399` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:38.801509 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6df1526de84b369b7233dce0021399)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:38.803496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:38.857250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6df1526de84b369b7233dce0021399'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:38.857900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6df1526de84b369b7233dce0021399'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:38.864981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6df1526de84b369b7233dce0021399'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:38.878221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6df1526de84b369b7233dce0021399'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:38.878889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6df1526de84b369b7233dce0021399'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:38.892152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1242/2453] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:38 2022] DELETE /identity/v3/users/3f6df1526de84b369b7233dce0021399 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:38.896846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:38.897540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:38.897540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:38.920665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:38.922043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:38.988092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1212/2454] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:38.999524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.001094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.044720 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:39.097605 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718deac-de7f-4d27-873a-44202af3e987 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.113171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.113171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.113171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.113171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.114983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.119264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:39.128979 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1243/2455] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:39.480328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.481816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.499191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0a31-dc81-4709-8fe5-edee87c577f3 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.508267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.508952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.509234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.509503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] PATH_INFO: `/v3/projects/c0b660f2adb449dbab6670964e84b75f` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.510655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b660f2adb449dbab6670964e84b75f)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.513015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:39.543860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.545171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.563118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea6bd5-7d04-46cd-80e2-722876423538 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.583499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b660f2adb449dbab6670964e84b75f', 'request_id': 'req-11a37352-0fac-458c-865b-2357ea839430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.593626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b660f2adb449dbab6670964e84b75f', 'request_id': 'req-11a37352-0fac-458c-865b-2357ea839430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.602331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b660f2adb449dbab6670964e84b75f', 'request_id': 'req-11a37352-0fac-458c-865b-2357ea839430'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.615433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] The token cache is being invalidate because project c0b660f2adb449dbab6670964e84b75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:39.615948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.617196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-11a37352-0fac-458c-865b-2357ea839430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.619001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1213/2456] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:39 2022] DELETE /identity/v3/projects/c0b660f2adb449dbab6670964e84b75f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:39.624946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541783a-50ad-40ca-9fcf-ec3ba06121e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.625230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541783a-50ad-40ca-9fcf-ec3ba06121e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.625878 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541783a-50ad-40ca-9fcf-ec3ba06121e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.643494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.644493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.644809 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.645079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] PATH_INFO: `/v3/users/8e594b27a11e4533a8c6dbfb16f00b99` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.646238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e594b27a11e4533a8c6dbfb16f00b99)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.649369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d541783a-50ad-40ca-9fcf-ec3ba06121e6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:39.650083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:39.650888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d541783a-50ad-40ca-9fcf-ec3ba06121e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.668964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1214/2457] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:39.670421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.671118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.671406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.703095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:39.704945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.720823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1215/2458] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:39.726964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.732521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e594b27a11e4533a8c6dbfb16f00b99'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.733448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e594b27a11e4533a8c6dbfb16f00b99'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.739958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb90c1-0cc1-493d-ba9a-4a67ce73a427 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.744373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e594b27a11e4533a8c6dbfb16f00b99'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.751379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.752083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.752509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.752924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.753744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:27:39.754009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.755750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:39.764520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e594b27a11e4533a8c6dbfb16f00b99'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.765622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56668837-5481-4bf1-be6c-e76174c5b684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e594b27a11e4533a8c6dbfb16f00b99'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:39.772781 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1216/2459] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:27:39.774969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.777099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.786762 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1244/2460] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:39 2022] DELETE /identity/v3/users/8e594b27a11e4533a8c6dbfb16f00b99 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:27:39.792280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.792965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11434f-d071-437a-a831-ced9b1f9f8fa admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.793141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.793579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.805567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:39.820973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:39.823438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.866669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.867776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.868096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.868546 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.869275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.871228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:39.885090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:39.908637 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1217/2461] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:27:39 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:39.912378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.913816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1245/2462] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:39.923787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:39.925295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:39.978050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52506e0-3596-4557-925b-fdf3ed7b0153 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.983312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:39.983719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9185-c49e-4a7f-819a-b1cf76bf8e77 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:39.983918 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:39.984203 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:39.984479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:39.985139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:39.987144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.008281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1218/2463] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:27:39 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:27:40.012216 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:40.021753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2a95-f7c7-4d96-b174-23f808f58914 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:40.027792 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.028392 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.028829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.029110 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.029751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.031351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.037387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.037989 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.038270 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.038569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.044912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1219/2464] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:40.045992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:40.048026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.049473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.056490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21744-0485-45ee-9900-032dcbd0f32d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:40.059100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1246/2465] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:27:40.061240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.061831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.062113 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.062381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.063006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.064624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc6e9d-6173-48ab-bad6-8c8ab1f53248 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.077068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1220/2466] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:27:40.081042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:40.092387 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772aaec-bda9-4ecd-94c2-793ddd62d982 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:40.097464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.098115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.098408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.098658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] PATH_INFO: `/v3/projects/012782adab9f4042ba8eba801b36fca6/users/97d83374ebdb40919703f3d6a538693c/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.114883 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012782adab9f4042ba8eba801b36fca6, user_id=97d83374ebdb40919703f3d6a538693c, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.117877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.141290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1247/2467] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:27:40 2022] PUT /identity/v3/projects/012782adab9f4042ba8eba801b36fca6/users/97d83374ebdb40919703f3d6a538693c/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:40.152388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.152825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.153290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.190471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] MFA Rules not processed for user `97d83374ebdb40919703f3d6a538693c`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:40.192089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:40.266567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:40.278994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1221/2468] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:40.291383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:40.293325 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:40.381192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f988-3c76-4105-a32f-7b8419f114d9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:40.385920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.386529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.386822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.387094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.390594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:40.392426 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:40.414242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.414479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.438207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1248/2469] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:40.511877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f36dd-8184-4ada-8466-3c6c04faaead None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:40.543745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:40.544454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:40.544789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:40.545037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] PATH_INFO: `/v3/projects/489d5600624b4e67a13e48dcc5b05697` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:40.546917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489d5600624b4e67a13e48dcc5b05697)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:40.549093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:40.606470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489d5600624b4e67a13e48dcc5b05697', 'request_id': 'req-a6c73472-60e0-4e89-922d-703fe1ba5b33'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:40.620601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489d5600624b4e67a13e48dcc5b05697', 'request_id': 'req-a6c73472-60e0-4e89-922d-703fe1ba5b33'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:40.628919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489d5600624b4e67a13e48dcc5b05697', 'request_id': 'req-a6c73472-60e0-4e89-922d-703fe1ba5b33'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:40.641846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] The token cache is being invalidate because project 489d5600624b4e67a13e48dcc5b05697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:40.642211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:40.642876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:40.644773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1222/2470] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:40 2022] DELETE /identity/v3/projects/489d5600624b4e67a13e48dcc5b05697 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:44.209281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:44.218978 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1dd2-762a-48d8-9e3a-a010f9ef142b service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:44.236122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:44.273010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:44.273735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:44.274087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:44.274426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:44.276382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:44.376000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:44.377471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11876f8a-9215-41dd-88ab-e7f603333519 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:44.389117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1249/2471] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:44.832727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:44.834692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:44.927044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c73472-60e0-4e89-922d-703fe1ba5b33 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:44.937099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:44.938054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:44.938520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:44.938971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] PATH_INFO: `/v3/users/4e84e870c58e41bcb29984c54c608a45` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:44.941153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e84e870c58e41bcb29984c54c608a45)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:44.943665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:44.985810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:45.014919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e84e870c58e41bcb29984c54c608a45'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.026819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e84e870c58e41bcb29984c54c608a45'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.050490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e84e870c58e41bcb29984c54c608a45'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.051346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e84e870c58e41bcb29984c54c608a45'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.051960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e84e870c58e41bcb29984c54c608a45'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.071850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1223/2472] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:44 2022] DELETE /identity/v3/users/4e84e870c58e41bcb29984c54c608a45 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:45.076489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:45.076804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:45.077078 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:45.112935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:45.114319 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:45.189568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1250/2473] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:27:45.199953 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:45.201421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:45.264540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ecf6-fa43-4a5b-b2de-159e4af84b49 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:45.268288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:45.268923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:45.269195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:45.269461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:45.278719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:45.280090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92e569-3bc3-4b0b-bed0-9cab9c779cc2 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:45.290111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1224/2474] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:45.700510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:45.703107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:45.720957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128d07-893f-491b-b437-fc759a05d0ee None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:45.727645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:45.729205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:45.729676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:45.730262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] PATH_INFO: `/v3/projects/c38a95ad75b24fb3b1eed016b004f370` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:45.733341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38a95ad75b24fb3b1eed016b004f370)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:45.735254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:45.789361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38a95ad75b24fb3b1eed016b004f370', 'request_id': 'req-5305a8b3-8181-4c52-a011-a367f6af5dfc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.795984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38a95ad75b24fb3b1eed016b004f370', 'request_id': 'req-5305a8b3-8181-4c52-a011-a367f6af5dfc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.801642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38a95ad75b24fb3b1eed016b004f370', 'request_id': 'req-5305a8b3-8181-4c52-a011-a367f6af5dfc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.805437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:45.817635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] The token cache is being invalidate because project c38a95ad75b24fb3b1eed016b004f370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:45.818172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.818802 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:45.820549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1251/2475] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:45 2022] DELETE /identity/v3/projects/c38a95ad75b24fb3b1eed016b004f370 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:48.804429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0bcc-596b-4bab-a71f-aa8ef7ac6ebd None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:48.804989 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0bcc-596b-4bab-a71f-aa8ef7ac6ebd None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:48.805122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e0bcc-596b-4bab-a71f-aa8ef7ac6ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:48.825732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-926e0bcc-596b-4bab-a71f-aa8ef7ac6ebd None None] MFA Rules not processed for user `0c2b75a0f6a2403fa7d67ca3b8ea6285`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:48.826987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-926e0bcc-596b-4bab-a71f-aa8ef7ac6ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:48.880525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1225/2476] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:50.744190 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:50.745715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:50.839444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a8b3-8181-4c52-a011-a367f6af5dfc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:50.844516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:50.845457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:50.845741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:50.846584 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] PATH_INFO: `/v3/users/97d83374ebdb40919703f3d6a538693c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:50.848289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d83374ebdb40919703f3d6a538693c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:50.850011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:50.908033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d83374ebdb40919703f3d6a538693c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:50.908770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d83374ebdb40919703f3d6a538693c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:50.917490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d83374ebdb40919703f3d6a538693c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:50.931530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d83374ebdb40919703f3d6a538693c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:50.932404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d83374ebdb40919703f3d6a538693c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:50.948140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1252/2477] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:27:50 2022] DELETE /identity/v3/users/97d83374ebdb40919703f3d6a538693c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:27:50.952366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:50.952895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:50.952992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:50.995639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:27:50.996890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:51.061880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:51.076643 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1226/2478] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:27:51.086726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:51.088236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:51.160722 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7564f5-4d1e-49ab-9aff-67c7b0de8761 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:51.167429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:51.168113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:51.168540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:51.168875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:51.180992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:51.181820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776979c0-e422-40ff-913f-71ed4e342da4 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:51.192283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1253/2479] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:27:51.655800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:51.657581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:51.679904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ec7a4-eb57-4217-861f-bac32255b1d9 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:51.696778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:51.697412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:51.697699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:51.697949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] PATH_INFO: `/v3/projects/012782adab9f4042ba8eba801b36fca6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:51.699084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012782adab9f4042ba8eba801b36fca6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:51.701819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:51.748998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012782adab9f4042ba8eba801b36fca6', 'request_id': 'req-eea1e5c9-32f6-4f0c-af8d-94e255115787'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:51.757636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012782adab9f4042ba8eba801b36fca6', 'request_id': 'req-eea1e5c9-32f6-4f0c-af8d-94e255115787'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:51.764648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012782adab9f4042ba8eba801b36fca6', 'request_id': 'req-eea1e5c9-32f6-4f0c-af8d-94e255115787'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:51.777165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] The token cache is being invalidate because project 012782adab9f4042ba8eba801b36fca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:27:51.777365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:51.778048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:27:51.779670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1227/2480] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:27:51 2022] DELETE /identity/v3/projects/012782adab9f4042ba8eba801b36fca6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:01.187668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=11,keystone:SELECT=81,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:01.773475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:02.240996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:02.242071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:02.242566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:02.262601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:02.264075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:02.325805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1254/2481] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:28:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:02.370436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:02.371863 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:02.440276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e5c9-32f6-4f0c-af8d-94e255115787 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:02.445361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:02.445961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:02.446241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:02.446507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:02.454405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:02.456030 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:02.464842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1228/2482] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:28:07.243775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:07.245229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:07.338114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abeb6c-b047-4eb3-849c-fddd32451377 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:07.344354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:07.346522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:07.346795 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:07.347069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] PATH_INFO: `/v3/users/b388de2d6c594546b2f04caf1e29c9bf` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:07.348761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b388de2d6c594546b2f04caf1e29c9bf)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:07.351824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:07.423593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b388de2d6c594546b2f04caf1e29c9bf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.424968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b388de2d6c594546b2f04caf1e29c9bf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.433830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b388de2d6c594546b2f04caf1e29c9bf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.448439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b388de2d6c594546b2f04caf1e29c9bf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.449745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b388de2d6c594546b2f04caf1e29c9bf'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.467076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1255/2483] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:07 2022] DELETE /identity/v3/users/b388de2d6c594546b2f04caf1e29c9bf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:07.664136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:07.678413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363433c-1502-488a-824a-68ad2d61f066 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:07.755116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:07.755667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:07.755942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:07.756214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] PATH_INFO: `/v3/projects/02e3bd84437342a8ae06d9d9379fcd0c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:07.757383 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e3bd84437342a8ae06d9d9379fcd0c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:07.759509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:07.827440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e3bd84437342a8ae06d9d9379fcd0c', 'request_id': 'req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.836657 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e3bd84437342a8ae06d9d9379fcd0c', 'request_id': 'req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.843956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e3bd84437342a8ae06d9d9379fcd0c', 'request_id': 'req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.860247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] The token cache is being invalidate because project 02e3bd84437342a8ae06d9d9379fcd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:07.860699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.862202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:07.869078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1229/2484] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:07 2022] DELETE /identity/v3/projects/02e3bd84437342a8ae06d9d9379fcd0c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:07.870512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:07.872038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:07.885939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d2701-dab1-4750-a0a9-cb94879a50ed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:07.911661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:07.965702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:07.966369 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:07.966659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:07.966927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] PATH_INFO: `/v3/users/52b9356d16e04c74a27761b747009ea9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:07.968090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b9356d16e04c74a27761b747009ea9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:07.970036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.036533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b9356d16e04c74a27761b747009ea9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.037165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b9356d16e04c74a27761b747009ea9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.045196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b9356d16e04c74a27761b747009ea9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.062794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b9356d16e04c74a27761b747009ea9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.063855 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-db14c298-53f0-4888-bcd5-a56975fb0681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b9356d16e04c74a27761b747009ea9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.081691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1256/2485] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:07 2022] DELETE /identity/v3/users/52b9356d16e04c74a27761b747009ea9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:08.276184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:08.278192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:08.298218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2663354-e0b8-4c08-b8d1-aa6d5417c0eb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:08.317911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:08.372887 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:08.373679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.374094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.374468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] PATH_INFO: `/v3/projects/016e042602e447f08088207487f1ef58` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.375788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016e042602e447f08088207487f1ef58)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:08.378148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.500246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016e042602e447f08088207487f1ef58', 'request_id': 'req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.514947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016e042602e447f08088207487f1ef58', 'request_id': 'req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.524126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016e042602e447f08088207487f1ef58', 'request_id': 'req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.543394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] The token cache is being invalidate because project 016e042602e447f08088207487f1ef58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:08.543864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.547659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-cfbcf7f0-0b27-4a48-864b-b4c98d5bd0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:08.549853 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1230/2486] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:08 2022] DELETE /identity/v3/projects/016e042602e447f08088207487f1ef58 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:08.557383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.558025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.558213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.588039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:08.589394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:08.688513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1257/2487] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:08.698809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.699436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.699436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.729466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:08.730730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:08.739107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1231/2488] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:08.744133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:08.755275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0906-17a4-4b7f-a605-fb7626cb45a7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:08.761107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:08.761706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.761985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.762256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.763028 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:28:08.763336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:08.765056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.779360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1258/2489] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:28:08.783929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:08.794973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3e37f-c5c2-4795-83df-cd79aef5dd62 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:08.800111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:08.800759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.801040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.801309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.801936 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:08.804422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.839186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1232/2490] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:28:08 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:28:08.840197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:08.852693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d87c-568e-4b50-8c91-240033dd979e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:08.886606 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:08.920534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:08.921451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.921835 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.922207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.922945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:08.924982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.948568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1259/2491] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:28:08 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:28:08.952772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:08.964096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c0264-5579-42b1-8839-4735c36ff6ec admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:08.969221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:08.969958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:08.970235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:08.970659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:08.971299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:08.973107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:08.984831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1233/2492] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:28:08.988760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.000689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e544a6-27ff-4ea9-9505-ad8fb451b596 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.005812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.006670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.007554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.007827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.008471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.010086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760df0e-45ef-42a3-9ecb-d82d6f0faf06 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.021543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1260/2493] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:28:09.026688 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.038648 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e629e5-c114-469d-87db-a1b1468523a2 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.044704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.045652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.045783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.046084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] PATH_INFO: `/v3/projects/a13ea18cf6794021ad75d5081140eb70/users/357dd2148c6d41d4b8c5c7889ba832a5/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.062971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13ea18cf6794021ad75d5081140eb70, user_id=357dd2148c6d41d4b8c5c7889ba832a5, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.065730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.084291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1234/2494] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:28:09 2022] PUT /identity/v3/projects/a13ea18cf6794021ad75d5081140eb70/users/357dd2148c6d41d4b8c5c7889ba832a5/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:28:09.154000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.154296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.154567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.192701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] MFA Rules not processed for user `357dd2148c6d41d4b8c5c7889ba832a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:09.193999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:09.285366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1261/2495] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:09.286531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.343272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:09.364470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0ac15-ce5e-4cf1-9aa1-133c02f09be4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.370101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.370714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.371222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.371625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.372492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.374435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.409538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1235/2496] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:28:09.410681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.424545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc0065-3aca-4610-a7fe-0c6d43b82024 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.494033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.494775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.495118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.495456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.496197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.498227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.526787 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1262/2497] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:28:09.530874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.552848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b91330-adf6-41a4-af89-42e33244c690 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.563506 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.564684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.564684 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.565088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.566136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.568516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.588523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1236/2498] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:28:09.592206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.606827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445e81d-cf39-4e9f-9b95-33bf81dfaa26 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.611733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.612479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.612848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.613254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.614022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.615986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1db0-c409-44a6-906a-c4d5b947fe74 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.631548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1263/2499] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:28:09.636091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.648768 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bce67d-cf46-417c-bcb9-bb573ad80b94 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.653707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.654365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.654641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.654905 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] PATH_INFO: `/v3/projects/c9adb5eec757461297e5c449e99b1fd4/users/c621f0c9866647cba4f2af8474074f23/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.672683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9adb5eec757461297e5c449e99b1fd4, user_id=c621f0c9866647cba4f2af8474074f23, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.675428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.692115 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1237/2500] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:28:09 2022] PUT /identity/v3/projects/c9adb5eec757461297e5c449e99b1fd4/users/c621f0c9866647cba4f2af8474074f23/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:09.702655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.702946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.703225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.737109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] MFA Rules not processed for user `c621f0c9866647cba4f2af8474074f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:09.738748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:09.746065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:09.813553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1264/2501] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:09.817702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.888186 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5e79e-59e3-42db-ad7d-53915baf0283 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:09.893000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:09.893602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:09.893877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:09.894144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:09.894782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:09.896898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:09.932734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1238/2502] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:28:09.934192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:09.946349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c19d-22d6-4973-854d-28c75cf754ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.008141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.008954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.009332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.009719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.011553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.012486 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.036493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1265/2503] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:28:09 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:28:10.040445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:10.051502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487eb5f-2b9e-4c61-950a-053c64f0d6ad admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.057704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.058335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.058616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.059029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.059670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.061307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.075708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1239/2504] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:28:10.076884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:10.087538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb00798-1ab9-49cb-b0d9-d54b3e85a537 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.092348 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.093074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.093316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.093711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] PATH_INFO: `/v3/projects/03f57e6c19d044d7a9f37d417bcae35a/users/74a344168aac4d3aa733236a4245b3f3/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.109689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f57e6c19d044d7a9f37d417bcae35a, user_id=74a344168aac4d3aa733236a4245b3f3, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.112333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.127454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1266/2505] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:28:10 2022] PUT /identity/v3/projects/03f57e6c19d044d7a9f37d417bcae35a/users/74a344168aac4d3aa733236a4245b3f3/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:28:10.131707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:10.143050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888919-c6e3-4e2b-972d-8e1be5b685e6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.216825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.217351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.217703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.218046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.218775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.220537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321050fc-3f13-450a-b076-68f368715dfd admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.236618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1240/2506] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:28:10.238732 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:10.253249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf40dcb-c6ac-49fe-9744-46ddc7b86010 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.259834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.260675 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.261073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.261534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] PATH_INFO: `/v3/projects/03f57e6c19d044d7a9f37d417bcae35a/users/74a344168aac4d3aa733236a4245b3f3/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.263565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f57e6c19d044d7a9f37d417bcae35a, user_id=74a344168aac4d3aa733236a4245b3f3, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.266478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.279472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1267/2507] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:28:10 2022] PUT /identity/v3/projects/03f57e6c19d044d7a9f37d417bcae35a/users/74a344168aac4d3aa733236a4245b3f3/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:10.291459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.291833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.292194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.311118 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:10.328243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] MFA Rules not processed for user `74a344168aac4d3aa733236a4245b3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:10.329617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:10.409280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1241/2508] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:10.423601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:10.425731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:10.489571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989f1e7-8c51-43c8-96b1-34ae6907a5e9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:10.494540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:10.495272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:10.495645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:10.496007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:10.509911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:10.567669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:10.569323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:10.581867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1268/2509] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:12.207064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:12.215356 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:12.232002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0421448-b687-4474-ae57-fe0508fc5a56 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:12.237676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:12.238503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:12.238902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:12.239435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:12.310919 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:12.312403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:12.324900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1242/2510] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:12.926902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:12.937133 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577186-3eab-4afc-b1aa-38c5f0b56908 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:12.941180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:12.941964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:12.942255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:12.942528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:12.953056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:12.954487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e60b11-c9af-4eb1-a508-fb689bec9dbd service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:12.965886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1269/2511] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:17.001397 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:17.083317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13543702-a983-4b65-966a-722afce92c0b service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:17.090057 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:17.090872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:17.091256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:17.091628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] PATH_INFO: `/v3/users/357dd2148c6d41d4b8c5c7889ba832a5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:17.092891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357dd2148c6d41d4b8c5c7889ba832a5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:17.095228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:17.138114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:17.155963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357dd2148c6d41d4b8c5c7889ba832a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.165012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357dd2148c6d41d4b8c5c7889ba832a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.181255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357dd2148c6d41d4b8c5c7889ba832a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.182007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357dd2148c6d41d4b8c5c7889ba832a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.182642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357dd2148c6d41d4b8c5c7889ba832a5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.202481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1243/2512] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:17 2022] DELETE /identity/v3/users/357dd2148c6d41d4b8c5c7889ba832a5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:17.204351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:17.205334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:17.206843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:17.234226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:17.235634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:17.308510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1270/2513] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:17.315149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:17.316922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:17.392527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7439d5-7f7c-45f4-b16f-cc07645ac8e8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:17.396452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:17.397297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:17.397678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:17.398048 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:17.408698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:17.410159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:17.422619 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1244/2514] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:17.779838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:17.784385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:17.814905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8bd3c-fd5d-40e3-899c-47763f7d6ce8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:17.820328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:17.821146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:17.821529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:17.821922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] PATH_INFO: `/v3/projects/a13ea18cf6794021ad75d5081140eb70` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:17.823154 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13ea18cf6794021ad75d5081140eb70)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:17.825194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:17.885748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13ea18cf6794021ad75d5081140eb70', 'request_id': 'req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.892268 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13ea18cf6794021ad75d5081140eb70', 'request_id': 'req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.899867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13ea18cf6794021ad75d5081140eb70', 'request_id': 'req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.917469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] The token cache is being invalidate because project a13ea18cf6794021ad75d5081140eb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:17.917916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.918664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:17.920269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1271/2515] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:17 2022] DELETE /identity/v3/projects/a13ea18cf6794021ad75d5081140eb70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:28:17.924821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:17.937647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258ac01-b7a4-4848-9ad4-79bc656f4447 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:18.002609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:18.003343 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:18.003576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:18.003851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] PATH_INFO: `/v3/users/c621f0c9866647cba4f2af8474074f23` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:18.005024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c621f0c9866647cba4f2af8474074f23)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:18.007488 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:18.067192 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c621f0c9866647cba4f2af8474074f23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.073481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:18.075485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c621f0c9866647cba4f2af8474074f23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.091409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c621f0c9866647cba4f2af8474074f23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.092164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c621f0c9866647cba4f2af8474074f23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.092799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c621f0c9866647cba4f2af8474074f23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.110278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1245/2516] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:17 2022] DELETE /identity/v3/users/c621f0c9866647cba4f2af8474074f23 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:18.413894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:18.416146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:18.432371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3086d2-b9fd-49b3-9409-59bb6d9c8a3b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:18.462353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:18.505280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:18.505914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:18.506197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:18.506469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] PATH_INFO: `/v3/projects/c9adb5eec757461297e5c449e99b1fd4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:18.508215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9adb5eec757461297e5c449e99b1fd4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:18.510162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:18.558110 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9adb5eec757461297e5c449e99b1fd4', 'request_id': 'req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.564182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9adb5eec757461297e5c449e99b1fd4', 'request_id': 'req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.570137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9adb5eec757461297e5c449e99b1fd4', 'request_id': 'req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.582375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] The token cache is being invalidate because project c9adb5eec757461297e5c449e99b1fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:18.582659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.583260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-91b604a9-11bc-40a5-b4ae-4611daf2e8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.584818 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1272/2517] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:18 2022] DELETE /identity/v3/projects/c9adb5eec757461297e5c449e99b1fd4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:18.589455 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:18.590957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:18.604403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a10d40-4407-45fc-aed7-9a71ebf9d5c5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:18.664998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:18.665638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:18.665917 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:18.666191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] PATH_INFO: `/v3/users/74a344168aac4d3aa733236a4245b3f3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:18.667427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a344168aac4d3aa733236a4245b3f3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:18.669472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:18.723405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a344168aac4d3aa733236a4245b3f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.730982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a344168aac4d3aa733236a4245b3f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.745099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a344168aac4d3aa733236a4245b3f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.745871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a344168aac4d3aa733236a4245b3f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.746476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a344168aac4d3aa733236a4245b3f3'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:18.762971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1246/2518] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:18 2022] DELETE /identity/v3/users/74a344168aac4d3aa733236a4245b3f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:18.961308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:18.961609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:18.961887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:18.982360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:18.983551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:19.045954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1273/2519] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:19.061300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:19.062877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:19.074152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:19.076297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:19.136157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:19.156501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076223a-8284-4876-ab05-8d610ab67659 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:19.160168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9762a2-b4f1-4370-98e3-2b05bb981375 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:19.161593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:19.162222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:19.162501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:19.162774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] PATH_INFO: `/v3/projects/03f57e6c19d044d7a9f37d417bcae35a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:19.165141 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f57e6c19d044d7a9f37d417bcae35a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:19.166194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:19.166816 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:19.167035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:19.167342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:19.167545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:19.168843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:19.177193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:19.180750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:19.189249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1247/2520] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:28:19.226527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f57e6c19d044d7a9f37d417bcae35a', 'request_id': 'req-c9c6327a-26e2-4206-a5b5-09064967522e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:19.233658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f57e6c19d044d7a9f37d417bcae35a', 'request_id': 'req-c9c6327a-26e2-4206-a5b5-09064967522e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:19.240143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f57e6c19d044d7a9f37d417bcae35a', 'request_id': 'req-c9c6327a-26e2-4206-a5b5-09064967522e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:19.259215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] The token cache is being invalidate because project 03f57e6c19d044d7a9f37d417bcae35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:19.259514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:19.260207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:19.261752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1274/2521] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:19 2022] DELETE /identity/v3/projects/03f57e6c19d044d7a9f37d417bcae35a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:28:21.192770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:21.194502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:21.210716 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa0c9e-8bd3-4c31-8518-10bc4d513ae4 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:21.267537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:21.268086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.268361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.268662 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] PATH_INFO: `/v3/users/e8257392699b493cbecd42ceb62ddff5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.269804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8257392699b493cbecd42ceb62ddff5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:21.271724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:21.322740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8257392699b493cbecd42ceb62ddff5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.329946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8257392699b493cbecd42ceb62ddff5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.342310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8257392699b493cbecd42ceb62ddff5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.343007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8257392699b493cbecd42ceb62ddff5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.343638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2a000e99-d657-4e65-98d6-77979f38c1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8257392699b493cbecd42ceb62ddff5'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.357002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1248/2522] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:28:21 2022] DELETE /identity/v3/users/e8257392699b493cbecd42ceb62ddff5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:21.533093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:21.534706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:21.549488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6327a-26e2-4206-a5b5-09064967522e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:21.617108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:21.618250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.618531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.618804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] PATH_INFO: `/v3/projects/b0ea853ab41d415d863ce8e512d0eac5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.619996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ea853ab41d415d863ce8e512d0eac5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:21.621922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:21.670374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ea853ab41d415d863ce8e512d0eac5', 'request_id': 'req-49b39715-880b-42b1-9bee-b6bd7816465d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.676289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ea853ab41d415d863ce8e512d0eac5', 'request_id': 'req-49b39715-880b-42b1-9bee-b6bd7816465d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.683084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ea853ab41d415d863ce8e512d0eac5', 'request_id': 'req-49b39715-880b-42b1-9bee-b6bd7816465d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.695898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] The token cache is being invalidate because project b0ea853ab41d415d863ce8e512d0eac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:28:21.696231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.696869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49b39715-880b-42b1-9bee-b6bd7816465d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:28:21.698354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1275/2523] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:28:21 2022] DELETE /identity/v3/projects/b0ea853ab41d415d863ce8e512d0eac5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:21.703197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.703484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.703759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.723525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:21.724777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:21.776668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:21.785837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1249/2524] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:21.794549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.794849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.795160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.815673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:21.816903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:21.824597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1276/2525] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:21.828975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:21.839443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add889b7-4479-49cc-9c45-d4fcfae24f46 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:21.844218 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:21.844860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.845141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.845412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.846058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:28:21.846386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:21.847992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:21.860782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1250/2526] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:28:21.865038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:21.874973 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5907f-a890-40ef-95eb-9f3d6a592ab9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:21.879610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:21.880197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.880472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.880770 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.881390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:21.883273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:21.894256 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:21.911903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1277/2527] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:28:21 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:28:21.916890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:21.927411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21745263-a397-4350-bde1-f4c8e0c39ab4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:21.984097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:21.984763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:21.985045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:21.985317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:21.985957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:21.987908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:22.009290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1251/2528] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:28:21 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:28:22.013617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:22.024743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588f3e-5d6e-4d3a-98c9-f9614f3af7ac admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:22.029504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:22.030066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.030345 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.030618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:22.031255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:22.033128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:22.043791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1278/2529] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:28:22.047569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:22.057528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d49e6-3743-4817-96d4-b7dc06e4349a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:22.062416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:22.063022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.063305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.063580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:22.064221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:22.065843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3fcc9-e901-4014-9701-cfa0dc681e8a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:22.076385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1252/2530] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:28:22.080505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:22.092702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947095-dcbc-4fd8-b902-e586e0560c91 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:22.097562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:22.098211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.098487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.098756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] PATH_INFO: `/v3/projects/d18ec3cfedf944b38a810efc2a866630/users/bdcea89e98854e90ac8725dc66f437e3/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:22.114287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18ec3cfedf944b38a810efc2a866630, user_id=bdcea89e98854e90ac8725dc66f437e3, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:22.116943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:22.130231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1279/2531] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:28:22 2022] PUT /identity/v3/projects/d18ec3cfedf944b38a810efc2a866630/users/bdcea89e98854e90ac8725dc66f437e3/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:28:22.135358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69432b4-6020-4190-9b4d-c982f960668e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.135642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69432b4-6020-4190-9b4d-c982f960668e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.135913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69432b4-6020-4190-9b4d-c982f960668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:22.155957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d69432b4-6020-4190-9b4d-c982f960668e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:22.157304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d69432b4-6020-4190-9b4d-c982f960668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:22.217742 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1253/2532] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:22.227988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:22.229731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:22.287405 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063b10-0c8f-438e-806c-a68839e772c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:22.291664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:22.292260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.292538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.292847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:22.301838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:22.303244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:22.313043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1280/2533] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:22.977838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc09c6b-0fef-40b2-a892-9768e11529f5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:22.978138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc09c6b-0fef-40b2-a892-9768e11529f5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:22.978401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc09c6b-0fef-40b2-a892-9768e11529f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:23.007667 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-4dc09c6b-0fef-40b2-a892-9768e11529f5 None None] MFA Rules not processed for user `bdcea89e98854e90ac8725dc66f437e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:23.008906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4dc09c6b-0fef-40b2-a892-9768e11529f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:23.077743 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:23.088733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1254/2534] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:23.100165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:23.102131 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:23.161679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17279c-0749-4dec-91a7-3d52e970f3f9 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:23.165827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:23.166424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:23.166697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:23.166965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:23.175161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:23.176572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:23.204738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1281/2535] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:24.566820 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbcda-cddd-43e9-885b-f912a1dbf155 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:24.567327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbcda-cddd-43e9-885b-f912a1dbf155 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:24.567424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbcda-cddd-43e9-885b-f912a1dbf155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:24.587579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8dddbcda-cddd-43e9-885b-f912a1dbf155 None None] MFA Rules not processed for user `bdcea89e98854e90ac8725dc66f437e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:24.588933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8dddbcda-cddd-43e9-885b-f912a1dbf155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:24.595819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1255/2536] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:28:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:33.196625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:34.581515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:37.603859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:37.605378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:37.688094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf742f-7389-48f0-a0a2-a141dea42121 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:37.694524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:37.695229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:37.697034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:37.697386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:37.699386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:37.713889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:37.716035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:37.728848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1282/2537] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:47.723639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=32 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:59.703265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391af4-2a68-4813-bdb0-19e766b249c4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:59.703797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391af4-2a68-4813-bdb0-19e766b249c4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:59.703965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391af4-2a68-4813-bdb0-19e766b249c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:59.723033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f3391af4-2a68-4813-bdb0-19e766b249c4 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:28:59.724232 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f3391af4-2a68-4813-bdb0-19e766b249c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:59.779476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1256/2538] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:28:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:28:59.792330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:28:59.793765 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:28:59.861808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec259-db6f-44e9-bdb6-7e2e8ca1dcd5 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:28:59.866747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:28:59.867339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:28:59.868416 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:28:59.868734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:28:59.876671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:28:59.878261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:28:59.886532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1283/2539] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:28:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:29:03.180996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d997-1a31-4430-9045-24f9066c4e74 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:03.181562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d997-1a31-4430-9045-24f9066c4e74 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:03.181562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d997-1a31-4430-9045-24f9066c4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:03.208956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b781d997-1a31-4430-9045-24f9066c4e74 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:03.210291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b781d997-1a31-4430-9045-24f9066c4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:03.219799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1257/2540] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:03.252399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:03.255033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:03.366023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ff825-fdd2-4bd8-a9e0-27a46d1a94de service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:03.373959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:03.374581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:03.375643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:03.375643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:03.389710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:03.391519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:03.403162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1284/2541] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:07.388105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78b8d-4e7f-4bb8-ba1e-e24ca115ba7e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:07.388105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78b8d-4e7f-4bb8-ba1e-e24ca115ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:07.388105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f78b8d-4e7f-4bb8-ba1e-e24ca115ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:07.413010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-90f78b8d-4e7f-4bb8-ba1e-e24ca115ba7e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:07.414759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-90f78b8d-4e7f-4bb8-ba1e-e24ca115ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:07.423704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1258/2542] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:07.447977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:07.450236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:07.466861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f62866-d531-49e8-9379-35e245b97943 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:07.472336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:07.472959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:07.473242 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:07.473516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:07.482568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:07.484145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:07.495117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1285/2543] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:11.613889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea3a3-ef75-46b7-9b8f-7bf0811472f6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:11.614470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea3a3-ef75-46b7-9b8f-7bf0811472f6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:11.614470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea3a3-ef75-46b7-9b8f-7bf0811472f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:11.635163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-abaea3a3-ef75-46b7-9b8f-7bf0811472f6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:11.636372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-abaea3a3-ef75-46b7-9b8f-7bf0811472f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:11.644204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1259/2544] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:11.659790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:11.671039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff63fe-d2cf-46cf-8733-45da12a0bb16 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:11.676548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:11.677156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:11.677466 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:11.677744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:11.686391 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:11.687950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:11.697953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1286/2545] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:15.760317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db46-9eb3-48ba-89de-0c4ce0a091c7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:15.760826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db46-9eb3-48ba-89de-0c4ce0a091c7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:15.760934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679db46-9eb3-48ba-89de-0c4ce0a091c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:15.782505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2679db46-9eb3-48ba-89de-0c4ce0a091c7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:15.783921 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2679db46-9eb3-48ba-89de-0c4ce0a091c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:15.793476 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1260/2546] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:29:15.808520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:15.819757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f011a5-b396-4b73-b382-5a7c4939c4ae service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:15.825827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:15.826476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:15.826758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:15.827031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:15.835854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:15.838314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38d357-03b6-4cb6-9a66-c78245a743c6 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:15.848538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1287/2547] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:17.522204 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.522758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.522758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.524228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1261/2548] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:29:17.530510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da67d5-5fab-417a-aadc-72c4e2833718 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.530980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da67d5-5fab-417a-aadc-72c4e2833718 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.531085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da67d5-5fab-417a-aadc-72c4e2833718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.551060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-18da67d5-5fab-417a-aadc-72c4e2833718 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:17.552283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-18da67d5-5fab-417a-aadc-72c4e2833718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:17.562265 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1288/2549] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:29:17.574843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:17.577370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:17.637311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b68d-f073-4ec0-b9e7-9dcb172f5d26 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:17.641171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:17.641882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.642233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.642572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.657715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:17.657715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd987687-acf4-4153-a35c-a2fe63336ff4 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:17.667462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1262/2550] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:17.741782 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.742002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.742340 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.744892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1289/2551] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:29:17.749281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0994-656b-4827-b675-a47ad675438a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.749568 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0994-656b-4827-b675-a47ad675438a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.749868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0994-656b-4827-b675-a47ad675438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.770297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2dcf0994-656b-4827-b675-a47ad675438a None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:17.771502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2dcf0994-656b-4827-b675-a47ad675438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:17.778765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1263/2552] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:17.792171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:17.793955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:17.807572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0b4f2-e6b4-44df-9127-3f598aa256f8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:17.811057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:17.811635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.811905 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.812169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.819018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:17.820557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eabc5c-00e7-4e49-b7e3-4b36ab7fe916 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:17.828356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1290/2553] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:17.942646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315108-523a-4c21-aa9d-bab5bab1e33b None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.942934 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315108-523a-4c21-aa9d-bab5bab1e33b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.943207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315108-523a-4c21-aa9d-bab5bab1e33b None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.944552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1264/2554] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:29:17.949864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9a24-2289-4bd0-89d5-5350b09ca6f8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:17.950181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9a24-2289-4bd0-89d5-5350b09ca6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:17.950456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9a24-2289-4bd0-89d5-5350b09ca6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:17.970854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d45a9a24-2289-4bd0-89d5-5350b09ca6f8 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:17.972221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d45a9a24-2289-4bd0-89d5-5350b09ca6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:17.982080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1291/2555] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:17.994635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315108-523a-4c21-aa9d-bab5bab1e33b None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:18.005642 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315108-523a-4c21-aa9d-bab5bab1e33b None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:18.009707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:18.010299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:18.010578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:18.010850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:18.020981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:18.022403 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:18.033367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1265/2556] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:19.939841 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62678a-605a-4364-9397-c28c43d0cd00 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:19.940393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62678a-605a-4364-9397-c28c43d0cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:19.940490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62678a-605a-4364-9397-c28c43d0cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:19.962944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2c62678a-605a-4364-9397-c28c43d0cd00 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:19.964293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2c62678a-605a-4364-9397-c28c43d0cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:19.981847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1292/2557] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:19.988777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:20.000951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7dcf0-4af1-456b-9d72-0b3a90fca123 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:20.006836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:20.007567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:20.008000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:20.008278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:20.016994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:20.018630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:20.029168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1266/2558] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:21.037592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba13b-05ed-4936-9011-d8f060bd80de None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:21.038080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba13b-05ed-4936-9011-d8f060bd80de None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:21.038171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba13b-05ed-4936-9011-d8f060bd80de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:21.045419 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:21.058055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5b8ba13b-05ed-4936-9011-d8f060bd80de None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:21.059317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5b8ba13b-05ed-4936-9011-d8f060bd80de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:21.066414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1293/2559] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:29:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:21.079032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:21.090836 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a62e09-1f38-41d5-aad2-62a073c80d2f service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:21.095784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:21.096369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:21.096683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:21.096956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:21.105022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:21.106532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:21.114404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1267/2560] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:31.052740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:31.111185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=84 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:37.543827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286b8a3-63d7-48a9-8b91-2e25cd32dac0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:37.544389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286b8a3-63d7-48a9-8b91-2e25cd32dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:37.544389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286b8a3-63d7-48a9-8b91-2e25cd32dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:37.564351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b286b8a3-63d7-48a9-8b91-2e25cd32dac0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:37.565609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b286b8a3-63d7-48a9-8b91-2e25cd32dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:37.573726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1294/2561] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:37.589308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:37.601236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a98b7-e053-4194-b42f-17dd13ea3630 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:37.607600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:37.608185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:37.608465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:37.608766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:37.616916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:37.618516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:37.628268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1268/2562] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:29:45.406436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d388-12a3-4318-ab61-8b573945e568 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:45.406895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d388-12a3-4318-ab61-8b573945e568 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:45.406995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d388-12a3-4318-ab61-8b573945e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:45.426908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0cc1d388-12a3-4318-ab61-8b573945e568 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:45.428125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0cc1d388-12a3-4318-ab61-8b573945e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:45.435461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1295/2563] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:29:45.448339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:29:45.459315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c0c3-34af-45a2-b4fb-39a19fbe5519 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:29:45.465256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:29:45.465789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:45.466065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:45.466331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:45.474261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:29:45.475814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d306227-344f-4756-bdc1-5ed2ae3f15f9 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:29:45.483678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1269/2564] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:55.421475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:55.480503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=12 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:57.300046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:29:57.300529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:29:57.300672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:29:57.320317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] MFA Rules not processed for user `bdcea89e98854e90ac8725dc66f437e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:29:57.322083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:29:57.328791 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1296/2565] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:07.314996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:12.264563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe2aa7-ea10-4f46-87ee-fb4c6cd8b086 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:12.265091 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe2aa7-ea10-4f46-87ee-fb4c6cd8b086 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:12.265215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe2aa7-ea10-4f46-87ee-fb4c6cd8b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:12.285126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6dfe2aa7-ea10-4f46-87ee-fb4c6cd8b086 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:12.286314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6dfe2aa7-ea10-4f46-87ee-fb4c6cd8b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:12.294866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1270/2566] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:12.308597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:12.321301 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a29b2-cef2-4bf1-8f2d-43304cd689c2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:12.326346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:12.326929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:12.327202 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:12.327468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:12.335263 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:12.337372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:12.346383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1297/2567] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:15.523247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440049-8d15-4d5e-8c40-8ba612291d8b None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:15.523764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440049-8d15-4d5e-8c40-8ba612291d8b None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:15.523764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440049-8d15-4d5e-8c40-8ba612291d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:15.543987 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-78440049-8d15-4d5e-8c40-8ba612291d8b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:15.545215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-78440049-8d15-4d5e-8c40-8ba612291d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:15.553047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1271/2568] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:15.566789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:15.578115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118653-3dc1-4bd6-b370-e3807305000a service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:15.583522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:15.584098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:15.584373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:15.584756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:15.593164 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:15.594709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddbbdf-ab77-4ae2-b2fb-dd5718eb961d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:15.605291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1298/2569] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:19.657569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:19.658491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:19.658795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:19.678928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:19.681514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:19.683203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:19.683687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:19.683895 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:19.690659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1272/2570] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:19.704504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] MFA Rules not processed for user `0c2b75a0f6a2403fa7d67ca3b8ea6285`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:19.705431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:19.705733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:19.718558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4559ce-5b66-472c-ae55-eb8364aca03a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:19.724255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:19.724908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:19.725181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:19.725456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:19.734713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:19.736299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6841-1efe-41ef-93c7-f0971637580a service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:19.751519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1273/2571] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:30:19.770183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1299/2572] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:30:23.837828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8677-278e-44eb-8df2-f720e3d0cc08 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:23.838324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8677-278e-44eb-8df2-f720e3d0cc08 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:23.838422 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8677-278e-44eb-8df2-f720e3d0cc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:23.858258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-615e8677-278e-44eb-8df2-f720e3d0cc08 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:23.859481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-615e8677-278e-44eb-8df2-f720e3d0cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:23.867690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1274/2573] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:23.889625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:23.902363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46d2b9-94ca-4e61-bf2a-5e3116f97290 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:23.907755 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:23.908343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:23.908643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:23.908913 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:23.917599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:23.919252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:23.929094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1300/2574] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:28.063659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:28.064145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:28.064145 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:28.086209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:30:28.088880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:28.098109 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1275/2575] 10.222.0.82 () {58 vars in 1016 bytes} [Mon Sep 19 11:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:30:28.114741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:28.127064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235092-fcab-4b9e-82ca-b96bf4b80ea5 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:28.132587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:28.133174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:28.133448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:28.133742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:28.141784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:28.143357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:28.152858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1301/2576] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:38.079909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=21 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:38.148408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=49 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:40.402534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:40.414826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9251d9-6cc9-433e-95fc-ba4cb655b61f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:40.420044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:40.420753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:40.421031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:40.421308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:40.423047 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:40.437152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:40.438590 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:40.449925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1276/2577] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:50.444641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:53.428478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:53.429976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:53.442903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0c3-e819-49e0-b5af-e4789a5f6627 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:53.446528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:53.447109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:53.447390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:53.447773 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:53.449473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:53.463101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:53.464627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858b1f1-4f4d-41d2-b8a1-1bce46344954 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:53.475396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1302/2578] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:30:58.532861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:30:58.545965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4bafb-5b2e-4cce-903e-852c4d507439 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:30:58.551683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:30:58.552291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:30:58.552566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:30:58.552909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:30:58.554673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:30:58.630241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:30:58.631843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d9f1-bbc1-4db0-bcff-eb752d4486bb service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:30:58.642902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1277/2579] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:01.660222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d726-dafc-4def-8825-ff00321b5d14 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:01.660758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d726-dafc-4def-8825-ff00321b5d14 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:01.660956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6d726-dafc-4def-8825-ff00321b5d14 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:01.662602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1303/2580] 10.222.0.71 () {54 vars in 961 bytes} [Mon Sep 19 11:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:31:01.668818 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:01.669330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:01.669584 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:01.694814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] MFA Rules not processed for user `3189482c61b44937a73c99ff6ec36cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:01.696308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:01.707470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1278/2581] 10.222.0.71 () {58 vars in 1058 bytes} [Mon Sep 19 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:01.717077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6d726-dafc-4def-8825-ff00321b5d14 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:01.722762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:01.735790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6d726-dafc-4def-8825-ff00321b5d14 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:01.740681 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84160da-63d4-41b5-8fa5-ced7648fac08 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:01.741884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:01.742764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:01.743362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:01.743846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] PATH_INFO: `/v3/users/bdcea89e98854e90ac8725dc66f437e3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:01.746054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcea89e98854e90ac8725dc66f437e3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:01.747945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:01.748099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:01.748923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:01.749470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:01.750513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:01.766111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:01.781720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:01.784004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb182-73fe-4480-824f-93cabd7a17bf service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:01.795714 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1279/2582] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:01.797175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:01.797531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:01.797812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:01.803259 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcea89e98854e90ac8725dc66f437e3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:01.804065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcea89e98854e90ac8725dc66f437e3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:01.813473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcea89e98854e90ac8725dc66f437e3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:01.817532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] MFA Rules not processed for user `bdb73bfe2c0141f6a18c50555dbfb662`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:01.818766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:01.827729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1280/2583] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:01.837726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcea89e98854e90ac8725dc66f437e3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:01.838798 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcea89e98854e90ac8725dc66f437e3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:01.851255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1304/2584] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:31:01 2022] DELETE /identity/v3/users/bdcea89e98854e90ac8725dc66f437e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:02.149997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.151890 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.165757 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d4356-a300-46bf-87e3-c9d38936b355 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.226001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.227519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.234829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.236095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.236382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.236693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] PATH_INFO: `/v3/projects/d18ec3cfedf944b38a810efc2a866630` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.237850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18ec3cfedf944b38a810efc2a866630)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.239765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.288927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a7b87-3c21-4c1e-9db3-5ddebd981c54 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.293067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18ec3cfedf944b38a810efc2a866630', 'request_id': 'req-9d41e2f1-d98e-4d12-99ab-4ef11693f691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:02.300955 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18ec3cfedf944b38a810efc2a866630', 'request_id': 'req-9d41e2f1-d98e-4d12-99ab-4ef11693f691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:02.309808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18ec3cfedf944b38a810efc2a866630', 'request_id': 'req-9d41e2f1-d98e-4d12-99ab-4ef11693f691'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:02.325174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] The token cache is being invalidate because project d18ec3cfedf944b38a810efc2a866630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:31:02.325605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:02.326364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9d41e2f1-d98e-4d12-99ab-4ef11693f691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:02.328260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1281/2585] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:31:02 2022] DELETE /identity/v3/projects/d18ec3cfedf944b38a810efc2a866630 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:02.333347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300485f0-db06-40e6-a82b-99279e002abf None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.333635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300485f0-db06-40e6-a82b-99279e002abf None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.334158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300485f0-db06-40e6-a82b-99279e002abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.342085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:02.342933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.343540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.343850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.344104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.345901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.356271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.357737 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f4fe9-15a0-4433-98d4-4abb057b3f29 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.359011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-300485f0-db06-40e6-a82b-99279e002abf None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:02.360214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-300485f0-db06-40e6-a82b-99279e002abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.366107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1305/2586] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:31:02.422522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1282/2587] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:31:02.430698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.431073 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.431351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.451987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:02.453203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.461972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1306/2588] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:02.466160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300485f0-db06-40e6-a82b-99279e002abf None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.476062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300485f0-db06-40e6-a82b-99279e002abf None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.481284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.481909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.482183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.482453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.483107 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:31:02.483412 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.485034 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.500884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1283/2589] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:31:02.502353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.511740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f015c4-b29a-49ad-9fcd-351e2b615b80 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.516923 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.517526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.517801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.518065 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.518757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.520653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.530864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:02.556357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1307/2590] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:31:02 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:31:02.563868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.574395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1b61-e35c-4a6a-8c21-acd34bb4c0ba admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.632808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.633417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.633697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.633972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.634592 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.636975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.678501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1284/2591] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:31:02 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:31:02.680594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.692388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c2eb-1430-48ec-a3a6-6d97b8bef612 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.697526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.698219 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.698874 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.699228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.699887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.700496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.701514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.702158 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.716622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1308/2592] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:02.719711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.731779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d0afa-f911-405b-a777-7cccad9a72ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.737746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.738943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.739227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.739497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.740166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.741807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.753189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1309/2593] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:02.764986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.776332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643a061-8079-453d-bbcd-f36503c0530a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.781184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.781819 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.782119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.782388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] PATH_INFO: `/v3/projects/060100a588064b2eb29049d245ada430/users/9de93f11094b4e00ad8b9ba635c21ef0/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.792572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381acf94-abd8-43b7-a137-36c5a7cd39c1 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:02.797675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:02.798278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.798555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.798731 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060100a588064b2eb29049d245ada430, user_id=9de93f11094b4e00ad8b9ba635c21ef0, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.798835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.800531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.803520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000ccb-decd-46a5-87f6-4216a369ebb2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.814510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:02.816384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1310/2594] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:31:02 2022] PUT /identity/v3/projects/060100a588064b2eb29049d245ada430/users/9de93f11094b4e00ad8b9ba635c21ef0/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:02.816522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:02.821159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:02.821438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:02.821708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:02.826858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1285/2595] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:02.841774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:02.842963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.902211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1311/2596] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:31:02.912725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:02.914150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:02.926156 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:02.985981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a326-cd28-43b7-9af2-0d64bd991a04 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:03.039677 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:03.040285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:03.040569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:03.040868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:03.051485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:03.053069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc1381-d0bb-4e0e-9673-c52a598dd3af service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:03.062796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1286/2597] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:05.211178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:05.214397 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:05.236216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398daa5a-bf77-4ca4-bba3-16832fec3118 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:05.240034 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:05.241056 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:05.241875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:05.242337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:05.244191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:05.259627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:05.261274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:05.272738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1312/2598] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:07.649726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:07.650257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:07.650257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:07.681411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] MFA Rules not processed for user `9de93f11094b4e00ad8b9ba635c21ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:07.683183 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:07.760741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1287/2599] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:07.765848 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:07.777926 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1baca-c596-464c-ac99-508232442223 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:07.782628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:07.783232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:07.783540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:07.783838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:07.784480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:07.786421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:07.816684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1313/2600] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:31:07 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:31:07.820703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:07.832193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26eccd-a1c9-43eb-8117-0cec1e77a619 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:07.890746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:07.899912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:07.900928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:07.901871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:07.902252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:07.902992 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:07.905044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:07.931707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1288/2601] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:31:07 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:31:07.934183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:07.945054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916e15-245c-477d-95f0-c865e31ba0a4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:07.950113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:07.950698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:07.951046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:07.951346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:07.951982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:07.953719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:07.964927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1314/2602] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:07.969213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:07.980484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818880b-1518-481f-ae85-571ecd5f8288 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:07.985246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:07.985910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:07.986193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:07.986474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] PATH_INFO: `/v3/projects/5eaab07332934e04be0aab4a51cdde12/users/83d847b534c046a7904af4cf0fcdd506/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:08.002428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaab07332934e04be0aab4a51cdde12, user_id=83d847b534c046a7904af4cf0fcdd506, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:08.005129 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:08.021294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1289/2603] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:31:07 2022] PUT /identity/v3/projects/5eaab07332934e04be0aab4a51cdde12/users/83d847b534c046a7904af4cf0fcdd506/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:08.025183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:08.035925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9a55-d695-4e5f-842e-724568e434a5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:08.094645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:08.101697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:08.102522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:08.102999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:08.103261 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:08.104873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:08.106460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd862828-cc6d-49ae-ae08-b9c240873304 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:08.117081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1315/2604] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:08.121748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:08.136690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7300f-5fde-4c63-943e-73f8d5d9ac4c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:08.142049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:08.142722 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:08.143003 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:08.143279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] PATH_INFO: `/v3/projects/5eaab07332934e04be0aab4a51cdde12/users/83d847b534c046a7904af4cf0fcdd506/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:08.145477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaab07332934e04be0aab4a51cdde12, user_id=83d847b534c046a7904af4cf0fcdd506, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:08.148143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:08.159864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1290/2605] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:31:08 2022] PUT /identity/v3/projects/5eaab07332934e04be0aab4a51cdde12/users/83d847b534c046a7904af4cf0fcdd506/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:12.888005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40b0e-3145-4eef-8731-2e470fe20eef None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:12.888545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40b0e-3145-4eef-8731-2e470fe20eef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:12.888545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40b0e-3145-4eef-8731-2e470fe20eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:12.927542 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-72d40b0e-3145-4eef-8731-2e470fe20eef None None] MFA Rules not processed for user `83d847b534c046a7904af4cf0fcdd506`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:12.928939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72d40b0e-3145-4eef-8731-2e470fe20eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:13.043648 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1316/2606] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:31:13.058656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:13.061327 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:13.169139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ef463-bdd0-46c8-867d-94136b73804a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:13.176068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:13.176997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:13.177355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:13.177556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:13.250812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:13.252478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:13.263788 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1291/2607] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:14.482204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:14.483000 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:14.483280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:14.507461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] MFA Rules not processed for user `9de93f11094b4e00ad8b9ba635c21ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:14.508842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:14.516708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1317/2608] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:17.719521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:17.731576 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f334-85b2-40e5-a509-b7def715cb82 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:17.738683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:17.739302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:17.739580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:17.739850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:17.741633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:17.755173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:17.756791 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:17.771040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1292/2609] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:24.498122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=40 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:27.766986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:30.792207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:30.794233 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:30.853160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926c7bf-b3ad-482b-93f9-ae93fdb45f4f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:30.857322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:30.857919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:30.858196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:30.858465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:30.860151 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:30.919231 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:30.920692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:30.930692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1318/2610] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:38.178400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:38.195710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb525a-a9ff-482e-8f93-7bd78a689f05 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:38.204802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:38.205485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:38.205772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:38.206043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:38.210405 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:38.235886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:38.237737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:38.254181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1293/2611] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:40.925873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=48 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:45.559367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:45.561480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:45.581222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941053e-820d-44ce-8a42-8cfae2dee063 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:45.588100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:45.588756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:45.589039 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:45.589322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:45.591831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:45.604868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:45.607255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:45.618871 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1319/2612] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:48.248269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:49.864231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:49.922428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52bec4-48ea-4e3c-90ff-de20850c93f9 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:49.926068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:49.926675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:49.926954 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:49.927226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:49.937911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:49.939349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:49.949114 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1294/2613] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:51.799121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:51.809462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db03bd-b4b0-4a14-855a-33d7ee86413a service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:51.813412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:51.814162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:51.814527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:51.815040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:51.817248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:51.887928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:51.889310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:51.900426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1320/2614] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:55.271434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.273023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:55.325574 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.329158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:55.344530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aadee-5778-4c1e-8278-18e41b82aa84 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:55.349138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:55.349756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.350030 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.350305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] PATH_INFO: `/v3/users/0c2b75a0f6a2403fa7d67ca3b8ea6285` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.351407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2b75a0f6a2403fa7d67ca3b8ea6285)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:55.353368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:55.360547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa70207-cf4d-4fef-abca-da2737f39a7a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:55.365929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:55.366604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.366951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.367404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.369185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:55.381502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:55.383219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:55.394676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1295/2615] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:31:55.401959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2b75a0f6a2403fa7d67ca3b8ea6285'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.403159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2b75a0f6a2403fa7d67ca3b8ea6285'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.410203 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2b75a0f6a2403fa7d67ca3b8ea6285'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.428821 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2b75a0f6a2403fa7d67ca3b8ea6285'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.429563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cf5b0ca7-f3fd-4a04-a1d7-aa82e0aff6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2b75a0f6a2403fa7d67ca3b8ea6285'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.443461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1321/2616] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:31:55 2022] DELETE /identity/v3/users/0c2b75a0f6a2403fa7d67ca3b8ea6285 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:31:55.618306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.629855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08194ddf-1dd6-4357-b03b-0934d8c4a7a0 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:55.687000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:55.687625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.687902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.688171 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] PATH_INFO: `/v3/projects/88d9cebff3ff4028bf6de760dafe35b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.689314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d9cebff3ff4028bf6de760dafe35b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:55.691243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:55.728686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:55.739626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d9cebff3ff4028bf6de760dafe35b1', 'request_id': 'req-e84c2c02-eb18-4722-ad92-186bef89653b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.747069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d9cebff3ff4028bf6de760dafe35b1', 'request_id': 'req-e84c2c02-eb18-4722-ad92-186bef89653b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.753317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d9cebff3ff4028bf6de760dafe35b1', 'request_id': 'req-e84c2c02-eb18-4722-ad92-186bef89653b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.764157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] The token cache is being invalidate because project 88d9cebff3ff4028bf6de760dafe35b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:31:55.764443 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.765100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e84c2c02-eb18-4722-ad92-186bef89653b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:31:55.766575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1296/2617] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:31:55 2022] DELETE /identity/v3/projects/88d9cebff3ff4028bf6de760dafe35b1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:55.771676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.771935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.772207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.792071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:55.793332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:55.839093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:55.853051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1322/2618] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:55.861035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.861320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.861595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.881896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:55.883085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:55.891703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1297/2619] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:55.895741 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.905663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0e5f2-a681-44d9-b6d8-131469d97d1e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:55.910333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:55.910927 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.911226 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.911480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.912222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:31:55.912522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:55.914143 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:55.925797 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1323/2620] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:31:55.930122 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.940656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd53dc-5662-444a-89a5-af79ec918821 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:55.945258 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:55.945846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:55.946121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:55.946386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:55.946997 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:55.948910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:55.976436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1298/2621] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:31:55 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:31:55.980482 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:55.990381 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611dd1-3a05-464e-a9e1-c28077aa9ee3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:56.046132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:56.046728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.047009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.047281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.047914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:56.049842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:56.072349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1324/2622] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:31:55 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:31:56.077490 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:56.087923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c747e-1ed3-4951-91c5-bd901c9b6808 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:56.092627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:56.093233 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.093519 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.093840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.094472 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:56.096125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:56.106167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1299/2623] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:56.110527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:56.120772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7520-84fa-411b-94c5-f53506a9e5d9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:56.126849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:56.127449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.127735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.128008 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.128691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:56.130280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1a8a-0158-493f-a6c0-6d08ca2b58ca admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:56.142478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1325/2624] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:31:56.148802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:56.164726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfd19-627b-423c-b0b1-22fc66cbeb33 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:56.169824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:56.170496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.170778 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.171056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] PATH_INFO: `/v3/projects/3930cdb61e7046bc9e0de11be124a3a5/users/5a306892d62443c598135dd717a3f04b/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.187635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3930cdb61e7046bc9e0de11be124a3a5, user_id=5a306892d62443c598135dd717a3f04b, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:56.191417 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:56.205607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1300/2625] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:31:56 2022] PUT /identity/v3/projects/3930cdb61e7046bc9e0de11be124a3a5/users/5a306892d62443c598135dd717a3f04b/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:31:56.210667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5da2-7d54-4f72-bed0-1a9f59a4d099 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.210951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5da2-7d54-4f72-bed0-1a9f59a4d099 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.211220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5da2-7d54-4f72-bed0-1a9f59a4d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.229944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-33ec5da2-7d54-4f72-bed0-1a9f59a4d099 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:31:56.231954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33ec5da2-7d54-4f72-bed0-1a9f59a4d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:56.289317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1326/2626] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:31:56.299467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:31:56.301219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:31:56.359294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018c4f1-6deb-4d36-8e47-529dfad41e4b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:31:56.363012 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:31:56.363612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:31:56.363892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:31:56.364165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:31:56.374092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:31:56.375515 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:31:56.384852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1301/2627] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:32:00.065936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae662b-cf93-4173-b7c6-2167d99facb0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:32:00.066424 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae662b-cf93-4173-b7c6-2167d99facb0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:32:00.066533 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae662b-cf93-4173-b7c6-2167d99facb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:32:00.102906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-91ae662b-cf93-4173-b7c6-2167d99facb0 None None] MFA Rules not processed for user `5a306892d62443c598135dd717a3f04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:32:00.104368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-91ae662b-cf93-4173-b7c6-2167d99facb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:32:00.159255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:00.180933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1327/2628] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:32:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:32:00.199390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:32:00.200829 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:32:00.271334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:00.287393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf243540-bbc5-4df5-9d5e-c28c5a970b4a service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:32:00.295655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:32:00.296773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:32:00.297050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:32:00.297326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:32:00.307083 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:32:00.310922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2c386-3ea2-4f9e-aed1-a46af4be18d5 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:32:00.337219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1302/2629] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:32:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:32:01.945823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:32:01.946334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:32:01.946447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:32:01.968035 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] MFA Rules not processed for user `5a306892d62443c598135dd717a3f04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:32:01.969290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:32:01.976264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1328/2630] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:32:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:32:10.341865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:11.962225 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:05.459182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee6ba-c95c-4c2f-85e0-ccce2ad7aa2c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:05.459749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee6ba-c95c-4c2f-85e0-ccce2ad7aa2c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:05.459845 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee6ba-c95c-4c2f-85e0-ccce2ad7aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:05.480731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1a7ee6ba-c95c-4c2f-85e0-ccce2ad7aa2c None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:05.481952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1a7ee6ba-c95c-4c2f-85e0-ccce2ad7aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:05.540261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1303/2631] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:05.586952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:05.588376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:05.659337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6a33-6229-4929-b606-75132d2cf09f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:05.664114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:05.664740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:05.665016 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:05.665282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:05.673794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:05.675343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803ea7a-1141-4941-8966-2e94ac9ba039 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:05.683192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1329/2632] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:33:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:15.533665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=25 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:15.679981 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=32 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:22.706998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:22.707734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:22.707734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:22.709308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1304/2633] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:33:22.716117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16b8b-bf2b-475d-a861-922bc8b44273 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:22.719038 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16b8b-bf2b-475d-a861-922bc8b44273 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:22.720541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16b8b-bf2b-475d-a861-922bc8b44273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:22.750704 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2be16b8b-bf2b-475d-a861-922bc8b44273 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:22.752253 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2be16b8b-bf2b-475d-a861-922bc8b44273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:22.762746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1330/2634] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:33:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:22.779536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:22.781777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:22.851869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd9e1-4e45-4608-a4ac-20a8cc63624c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:22.855615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:22.856266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:22.856544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:22.856849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:22.869994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:22.871459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92665d-4205-49c3-8f00-dfc1b2f1e9d7 service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:22.883534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1305/2635] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:33:22.959277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f627-074e-4ec1-a3ab-b73a7185183e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:22.959587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f627-074e-4ec1-a3ab-b73a7185183e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:22.959860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f627-074e-4ec1-a3ab-b73a7185183e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:22.961353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1331/2636] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:33:22.967053 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048bd3-e379-4618-ba4d-9bbcb60da818 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:22.967337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048bd3-e379-4618-ba4d-9bbcb60da818 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:22.967607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048bd3-e379-4618-ba4d-9bbcb60da818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:22.989938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-26048bd3-e379-4618-ba4d-9bbcb60da818 None None] MFA Rules not processed for user `443218c09bc54d46a7d97a9208d9d100`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:22.991148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-26048bd3-e379-4618-ba4d-9bbcb60da818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:22.998097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1306/2637] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:33:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:23.011564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f627-074e-4ec1-a3ab-b73a7185183e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:23.024118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f627-074e-4ec1-a3ab-b73a7185183e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:23.027827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:23.028431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:23.028742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:23.029024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:23.038193 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:23.039612 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c505-311c-4d0f-83a3-30416acc12f5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:23.049665 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1332/2638] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:33:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:33:23.150501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f67b-32d8-49a1-a658-907fb5c30e11 None None] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:23.150784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f67b-32d8-49a1-a658-907fb5c30e11 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:23.151054 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4f67b-32d8-49a1-a658-907fb5c30e11 None None] PATH_INFO: `/` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:23.152459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1307/2639] 10.222.0.71 () {54 vars in 921 bytes} [Mon Sep 19 11:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:33:23.158523 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aadc77-d407-471d-9ab2-d589b6bc1154 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:23.158838 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aadc77-d407-471d-9ab2-d589b6bc1154 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:23.159140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aadc77-d407-471d-9ab2-d589b6bc1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:23.181142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a6aadc77-d407-471d-9ab2-d589b6bc1154 None None] MFA Rules not processed for user `00af7c59942242d5ba2517f2c1b07d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:23.182388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a6aadc77-d407-471d-9ab2-d589b6bc1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:23.192945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1333/2640] 10.222.0.71 () {58 vars in 1018 bytes} [Mon Sep 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:23.205181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f67b-32d8-49a1-a658-907fb5c30e11 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:23.217391 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4f67b-32d8-49a1-a658-907fb5c30e11 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:23.221981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:23.222587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:23.222869 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:23.223143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:23.234291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:23.236698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:23.248229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1308/2641] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:33:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:33:24.929390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:24.929891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:24.930125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:24.951150 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:24.952349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:24.960645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1334/2642] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:24.973067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:24.984329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9db364-a717-4054-a5bb-27a8f3672905 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:24.989280 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:24.989866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:24.990143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:24.990413 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:24.998512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:25.000675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e241592-3691-44ad-95b6-90102ffe1afb service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:25.008523 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1309/2643] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:34.945638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=15 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:35.005367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=41 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:42.570806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:42.572220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:42.710063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5a85b-7f11-4fbe-ae35-3b1434a0ffc6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:42.714950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:42.715541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:42.715813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:42.716077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:42.717823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:42.728860 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:42.730425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:42.741123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1335/2644] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:33:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:33:45.747244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:45.747741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:45.747843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:45.777655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:33:45.778841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:33:45.793121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1310/2645] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:33:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:33:45.805431 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:33:45.817011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ca7b-3278-4281-b91c-1b6980cb3b62 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:33:45.821932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:33:45.822513 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:33:45.822822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:33:45.823092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:33:45.831940 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:33:45.833522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:33:45.841343 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1336/2646] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:33:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:55.787288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=10 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:55.838157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=69 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:41.576505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:34:41.597679 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cba60-4b20-4500-92be-7267ff98a4aa None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:34:41.601404 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:34:41.602007 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:34:41.602288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:34:41.602561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:34:41.604292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:34:41.627505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:34:41.628973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:34:41.637165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1311/2647] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:34:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:34:41.710975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:34:41.720492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f5cb5-57aa-49ec-acc4-a35722a40b19 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:34:41.724496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:34:41.725181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:34:41.725493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:34:41.725764 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:34:41.727541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:34:41.754384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:34:41.755814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:34:41.776240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1337/2648] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:34:51.634078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=15 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:51.773668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=15 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:00.508215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:00.516830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484883d-3534-47c8-83fc-9d36caa2f499 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:00.520537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:00.521153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:00.521431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:00.521702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:00.523406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:00.557867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:00.559317 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:00.578262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1312/2649] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:03.691237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:03.692786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:03.710844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50933fac-b768-441a-94d7-04b92e49eb14 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:03.715582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:03.716220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:03.716496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:03.716799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] PATH_INFO: `/v3/users/bdb73bfe2c0141f6a18c50555dbfb662` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:03.717954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb73bfe2c0141f6a18c50555dbfb662)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:03.719858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:03.768520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb73bfe2c0141f6a18c50555dbfb662'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:03.769438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb73bfe2c0141f6a18c50555dbfb662'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:03.777891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb73bfe2c0141f6a18c50555dbfb662'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:03.791176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb73bfe2c0141f6a18c50555dbfb662'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:03.791885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4031fbd0-2205-422c-adfc-05938a8fc4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb73bfe2c0141f6a18c50555dbfb662'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:03.809823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1338/2650] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:03 2022] DELETE /identity/v3/users/bdb73bfe2c0141f6a18c50555dbfb662 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:03.990257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.005503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bf3c8-469d-4811-8eb1-19ec541e9364 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.060819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.061452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.061734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.062006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] PATH_INFO: `/v3/projects/30243888b7344787bf314f8b1ae185c3` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.063117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30243888b7344787bf314f8b1ae185c3)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.065941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.111573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30243888b7344787bf314f8b1ae185c3', 'request_id': 'req-5b4b5211-05b3-4836-84a7-957f99fe7e0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:04.118219 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30243888b7344787bf314f8b1ae185c3', 'request_id': 'req-5b4b5211-05b3-4836-84a7-957f99fe7e0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:04.124313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30243888b7344787bf314f8b1ae185c3', 'request_id': 'req-5b4b5211-05b3-4836-84a7-957f99fe7e0f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:04.135211 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] The token cache is being invalidate because project 30243888b7344787bf314f8b1ae185c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:04.135505 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:04.136138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5b4b5211-05b3-4836-84a7-957f99fe7e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:04.137650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1313/2651] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:03 2022] DELETE /identity/v3/projects/30243888b7344787bf314f8b1ae185c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:04.143245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.143536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.143805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.209847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:04.211402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:04.272864 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1339/2652] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:04.283456 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.284131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.284633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.304676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:04.305881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:04.313790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1314/2653] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:04.318134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.328230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df4ba-8fae-4489-855e-4eb70c1509c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.333569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.334173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.334451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.334734 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.335362 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:04.335660 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.337315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.349986 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1340/2654] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:04.354286 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.363597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15ca27-18f2-4c37-a5af-67fbb5f03aba None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.368541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.369493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.369774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.370039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.370669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.372732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.403147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1315/2655] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:04 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:04.407639 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.422172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96576-f9ba-4b57-af9b-f8391ee0ee1b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.455564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:04.488227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.488866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.489145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.489441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.490089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.491985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.520276 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1341/2656] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:04 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:04.521596 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.532252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4893fc-c58f-422c-9f5f-51d1cfb9dd97 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.537534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.538148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.538415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.539018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.539900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.541601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.552499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1316/2657] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:04.556234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.570566 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5574f7-296c-4a6e-b078-8925e5d53885 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.576794 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.577396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.577677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.577950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.578598 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.580198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996fc98-0647-4ccd-87bf-ac3763cc6e9e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.591710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1342/2658] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:04.600410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.610860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f8265-5079-4967-9bf8-1328ec6d4f2c admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.616237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.616940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.617228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.617503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] PATH_INFO: `/v3/projects/19d0da550ae54ddb86f9571700d5ce17/users/ad0d40c6593f4111bba085681875b3f4/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.620544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:04.756659 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d0da550ae54ddb86f9571700d5ce17, user_id=ad0d40c6593f4111bba085681875b3f4, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.759406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.772367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1317/2659] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:04 2022] PUT /identity/v3/projects/19d0da550ae54ddb86f9571700d5ce17/users/ad0d40c6593f4111bba085681875b3f4/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:04.783599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.784328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.784328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.811618 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] MFA Rules not processed for user `ad0d40c6593f4111bba085681875b3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:04.812868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:04.877398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1343/2660] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:04.888340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:04.890040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:04.966486 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487cbd1-3ea9-45e6-8d9a-006bec8212e8 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:04.970138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:04.971450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:04.971721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:04.971984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:04.980028 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:04.981459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f04-f646-401e-8b90-69466458caf4 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:04.990738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1318/2661] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:13.519063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:13.581516 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5a4c-9313-4780-ad99-b3f3d8234151 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:13.586182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:13.586822 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:13.587101 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:13.587372 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] PATH_INFO: `/v3/users/ad0d40c6593f4111bba085681875b3f4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:13.588485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0d40c6593f4111bba085681875b3f4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:13.590415 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:13.630812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:13.638137 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0d40c6593f4111bba085681875b3f4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:13.638963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0d40c6593f4111bba085681875b3f4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:13.646748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0d40c6593f4111bba085681875b3f4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:13.658322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0d40c6593f4111bba085681875b3f4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:13.659105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0d40c6593f4111bba085681875b3f4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:13.676746 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1344/2662] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:13 2022] DELETE /identity/v3/users/ad0d40c6593f4111bba085681875b3f4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:13.681299 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:13.681765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:13.681872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:13.701432 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:13.702606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:13.760300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1319/2663] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:35:13.770676 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:13.772089 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:13.828169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2ba97-1df3-4dbe-9c10-d8cdf4134ff3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:13.832597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:13.833205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:13.833481 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:13.833752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:13.842638 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:13.844057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2037b-c91d-4588-b1db-72d8cae96b96 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:13.853459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1345/2664] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:35:14.117421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.119092 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:14.139658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e33e23-e155-43d5-adbf-82a0f00f4947 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.145676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.146316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.146575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.146831 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] PATH_INFO: `/v3/projects/19d0da550ae54ddb86f9571700d5ce17` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.147930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d0da550ae54ddb86f9571700d5ce17)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.149837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.203366 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d0da550ae54ddb86f9571700d5ce17', 'request_id': 'req-d99367b2-1580-4917-999d-ea32f92e77da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:14.213527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d0da550ae54ddb86f9571700d5ce17', 'request_id': 'req-d99367b2-1580-4917-999d-ea32f92e77da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:14.220389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d0da550ae54ddb86f9571700d5ce17', 'request_id': 'req-d99367b2-1580-4917-999d-ea32f92e77da'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:14.223154 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:14.235623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] The token cache is being invalidate because project 19d0da550ae54ddb86f9571700d5ce17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:14.236315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:14.237655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-d99367b2-1580-4917-999d-ea32f92e77da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:14.239789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1320/2665] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:14 2022] DELETE /identity/v3/projects/19d0da550ae54ddb86f9571700d5ce17 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:14.248942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.249254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.249858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.271889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:14.273125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:14.338715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1346/2666] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:14.347693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.347973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.348243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.367926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:14.369152 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:14.377139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1321/2667] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:14.382059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.391768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bc747-ba07-4026-b4db-d7de176be563 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.396452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.397057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.397337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.397609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.398255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:14.398559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.400153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.412489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1347/2668] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:14.416814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.426331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6ba87-aad8-4959-aece-a6ed1b9a683e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.430946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.431525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.431796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.432062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.432715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.434581 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.461790 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1322/2669] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:14.465892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.475706 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d227d1-37e6-4fb3-93ed-861219e97b00 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.519887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:14.533743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.534634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.534918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.535187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.535813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.537742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.560601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1348/2670] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:14.564320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.575822 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244a19-72e2-4277-b406-a166eab92923 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.582555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.583451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.583907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.584263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.585099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.586970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.597956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1323/2671] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:35:14.602017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.611872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec38f8-d068-41fe-8c7f-c36307de557b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.616884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.617469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.617745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.618014 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.618640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.620216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748312-e23b-4789-8b8f-d70e9a036ff5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.631530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1349/2672] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:14.635630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.646214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec58d-d986-436e-a937-fccf06283015 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.650879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.651518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.651795 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.652065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] PATH_INFO: `/v3/projects/95a22f6c4af340d8a4e04bdcc1101aa8/users/99bb2985bd3045c18b64872ea9438aaa/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.666603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a22f6c4af340d8a4e04bdcc1101aa8, user_id=99bb2985bd3045c18b64872ea9438aaa, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.669333 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.692709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1324/2673] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:14 2022] PUT /identity/v3/projects/95a22f6c4af340d8a4e04bdcc1101aa8/users/99bb2985bd3045c18b64872ea9438aaa/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:14.705182 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.705587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.706700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.737167 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] MFA Rules not processed for user `99bb2985bd3045c18b64872ea9438aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:14.738376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:14.809314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1350/2674] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:14.813800 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.874161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c863c-7895-4d5c-8d02-39a372185318 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.880717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.881314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.881587 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.881852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.882462 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.884367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:14.911406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1325/2675] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:14.915478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:14.927215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d61df-c55e-4cd9-94fa-aa07e38a5a9b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:14.985328 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e07018-a992-42af-863c-017499be670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:14.985922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e07018-a992-42af-863c-017499be670e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:14.986194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e07018-a992-42af-863c-017499be670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:14.986517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e07018-a992-42af-863c-017499be670e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:14.987657 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e07018-a992-42af-863c-017499be670e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:14.989615 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e07018-a992-42af-863c-017499be670e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.010690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1351/2676] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:14 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:15.014696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:15.025136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c840ba-eadf-45db-a622-643747b8a63f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:15.029692 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:15.030281 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.030557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.030824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.031459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:15.033079 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.042832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1326/2677] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:15.046857 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e07018-a992-42af-863c-017499be670e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:15.057448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e07018-a992-42af-863c-017499be670e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:15.062161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:15.062804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.063084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.063358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] PATH_INFO: `/v3/projects/60d91e7accb144e6a9dd95817dff16e9/users/9f6a4bf7855d41e088f3cf7a22313739/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.078581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d91e7accb144e6a9dd95817dff16e9, user_id=9f6a4bf7855d41e088f3cf7a22313739, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:15.081410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.094298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1352/2678] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:15 2022] PUT /identity/v3/projects/60d91e7accb144e6a9dd95817dff16e9/users/9f6a4bf7855d41e088f3cf7a22313739/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:15.098302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:15.108329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e2453-c84b-4b7d-ae12-1f5b99271c7f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:15.165503 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:15.166017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.166292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.166558 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.167184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:15.168787 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9c3b-a178-498a-acb1-19389a29bcd7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.170852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:15.180429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1327/2679] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:15.184241 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:15.194445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28fc3d-09f5-4abb-a3cf-0d0b5648bdb0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:15.199554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:15.200331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.200767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.201127 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] PATH_INFO: `/v3/projects/60d91e7accb144e6a9dd95817dff16e9/users/9f6a4bf7855d41e088f3cf7a22313739/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.203192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d91e7accb144e6a9dd95817dff16e9, user_id=9f6a4bf7855d41e088f3cf7a22313739, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:15.205982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.217955 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1353/2680] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:15 2022] PUT /identity/v3/projects/60d91e7accb144e6a9dd95817dff16e9/users/9f6a4bf7855d41e088f3cf7a22313739/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:15.230226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.230531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.230808 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.259341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] MFA Rules not processed for user `9f6a4bf7855d41e088f3cf7a22313739`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:15.260567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:15.336960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1328/2681] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:15.348475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:15.350322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:15.360308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:15.412505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edd48-f7ea-4522-8c87-2ee6aadbc9be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:15.416245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:15.416810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:15.417086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:15.417473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:15.477267 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:15.478683 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:15.488103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1354/2682] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:18.127010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:18.137055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3d982-5a02-4f77-97d0-3b83f570b9c6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:18.140605 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:18.141200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:18.141477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:18.141744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:18.151127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:18.152547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa83a2-3e13-4bae-aec9-da115febd60d service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:18.162288 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1329/2683] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:25.483507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=45 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:28.157623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=41 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:30.716820 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:30.790095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b313-2211-4da8-8653-64c76f8883fc service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:30.794752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:30.795378 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:30.795655 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:30.795925 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] PATH_INFO: `/v3/users/99bb2985bd3045c18b64872ea9438aaa` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:30.797079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bb2985bd3045c18b64872ea9438aaa)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:30.798985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:30.845679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bb2985bd3045c18b64872ea9438aaa'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:30.846336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bb2985bd3045c18b64872ea9438aaa'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:30.853910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bb2985bd3045c18b64872ea9438aaa'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:30.866236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bb2985bd3045c18b64872ea9438aaa'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:30.866870 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bb2985bd3045c18b64872ea9438aaa'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:30.879974 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1355/2684] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:30 2022] DELETE /identity/v3/users/99bb2985bd3045c18b64872ea9438aaa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:30.884502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:30.885026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:30.885231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:30.904348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:30.905580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:30.963796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1330/2685] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:35:30.973884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:30.975297 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:31.031827 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677e712-7fac-45cd-b3f7-5e89728f9743 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:31.036212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:31.036896 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:31.037192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:31.037469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:31.046250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:31.047658 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:31.057672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1356/2686] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:31.326565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:31.328087 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:31.340244 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cbc42-f8f7-4630-896a-cb70ba3e996a None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:31.344927 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:31.345560 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:31.345833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:31.346721 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] PATH_INFO: `/v3/projects/95a22f6c4af340d8a4e04bdcc1101aa8` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:31.348045 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a22f6c4af340d8a4e04bdcc1101aa8)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:31.349984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:31.396976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a22f6c4af340d8a4e04bdcc1101aa8', 'request_id': 'req-c3652f0d-2ef6-4771-816d-629413991ab7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.404807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a22f6c4af340d8a4e04bdcc1101aa8', 'request_id': 'req-c3652f0d-2ef6-4771-816d-629413991ab7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.411039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a22f6c4af340d8a4e04bdcc1101aa8', 'request_id': 'req-c3652f0d-2ef6-4771-816d-629413991ab7'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.421187 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] The token cache is being invalidate because project 95a22f6c4af340d8a4e04bdcc1101aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:31.421469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.422102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.423577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1331/2687] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:31 2022] DELETE /identity/v3/projects/95a22f6c4af340d8a4e04bdcc1101aa8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:31.428048 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:31.437617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d2f54-48e4-47cb-b2c1-5d2016a826d5 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:31.455963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:31.499536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:31.500252 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:31.500528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:31.500824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] PATH_INFO: `/v3/users/9f6a4bf7855d41e088f3cf7a22313739` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:31.502205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6a4bf7855d41e088f3cf7a22313739)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:31.505238 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:31.675939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6a4bf7855d41e088f3cf7a22313739'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.676600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6a4bf7855d41e088f3cf7a22313739'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.683695 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6a4bf7855d41e088f3cf7a22313739'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.695069 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6a4bf7855d41e088f3cf7a22313739'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.695689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a6cf8995-2510-404b-a7c7-a584c93a081a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6a4bf7855d41e088f3cf7a22313739'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:31.708227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1357/2688] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:31 2022] DELETE /identity/v3/users/9f6a4bf7855d41e088f3cf7a22313739 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:31.975398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:31.976846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:31.990557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652f0d-2ef6-4771-816d-629413991ab7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.046865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.047483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.047755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.048020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] PATH_INFO: `/v3/projects/60d91e7accb144e6a9dd95817dff16e9` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.049148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d91e7accb144e6a9dd95817dff16e9)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.051533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.081533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:32.099597 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d91e7accb144e6a9dd95817dff16e9', 'request_id': 'req-9a6f7777-94f4-4246-9cf8-552998c93c1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:32.106563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d91e7accb144e6a9dd95817dff16e9', 'request_id': 'req-9a6f7777-94f4-4246-9cf8-552998c93c1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:32.113811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d91e7accb144e6a9dd95817dff16e9', 'request_id': 'req-9a6f7777-94f4-4246-9cf8-552998c93c1b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:32.123896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] The token cache is being invalidate because project 60d91e7accb144e6a9dd95817dff16e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:32.124444 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:32.125102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9a6f7777-94f4-4246-9cf8-552998c93c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:32.126572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1332/2689] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:31 2022] DELETE /identity/v3/projects/60d91e7accb144e6a9dd95817dff16e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:32.132551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.133045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.133156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.152012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:32.153235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:32.212567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1358/2690] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:32.220483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.220827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.221101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.240700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:32.241886 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:32.249961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1333/2691] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:32.254916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.264510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57050-4cb6-49ee-aa4f-d68a2a30af4e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.269446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.270032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.270310 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.270579 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.271221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:32.271520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.273135 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.284449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1359/2692] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:32.288616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.297634 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418b74-9c4f-4899-9667-178bdd3f6779 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.302889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.303470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.303744 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.304009 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.304654 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.306507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.333194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1334/2693] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:32.337180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.347368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7296d1f-250c-4303-a76b-210df2319aae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.373501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:32.406682 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.407271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.407555 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.407825 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.408454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.411520 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.432312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1360/2694] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:32.436448 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.446912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cbefa-2a30-4914-a0eb-72d5b923e617 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.451520 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.452103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.452377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.452674 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.453305 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.454875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.465095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1335/2695] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:32.468889 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.478501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f27b-7966-4900-8cd2-4114bac6f137 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.483046 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.483614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.483888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.484157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.484866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.486569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede898d7-ca04-4e89-b0ac-278070afebcc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.496531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1361/2696] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:32.500704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.510828 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64272-04a1-49d2-a534-cdbd2273f284 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.515373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.516001 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.516278 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.516551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] PATH_INFO: `/v3/projects/49e22508d393432b8c642dd0ac3ab5ad/users/225b80900a7143df9821007bcb3f3ce6/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.531527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e22508d393432b8c642dd0ac3ab5ad, user_id=225b80900a7143df9821007bcb3f3ce6, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.534159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.546217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1336/2697] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:32 2022] PUT /identity/v3/projects/49e22508d393432b8c642dd0ac3ab5ad/users/225b80900a7143df9821007bcb3f3ce6/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:32.556331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.556677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.556953 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.585480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] MFA Rules not processed for user `225b80900a7143df9821007bcb3f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:32.586595 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:32.650964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1362/2698] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:32.655466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.717067 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392be62-966f-42da-a5f9-4c6978791ebb admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.721729 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.722329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.722607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.722874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.723494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.725395 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.752361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1337/2699] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:32.757212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.768198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0678a-958b-4fd8-b785-2e52f092463e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.824139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.824779 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.825055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.825321 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.825957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.827846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.850420 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1363/2700] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:32.854585 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.865738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7f615-7d26-43bc-8019-0c620b4b8325 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.870364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.870957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.871236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.871508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.872142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.873766 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.886274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1338/2701] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:32.890374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.900470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d15d-c20b-401c-9dcf-1572b7921781 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.905100 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.905684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.906025 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.906222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.906935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.908500 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2674-ae97-4dcd-9e0d-36d57bcc0aab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.919153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1364/2702] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:32.923389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:32.934261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81aa63d-851b-4ae2-bb8b-aeaf1cd27a07 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:32.938837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:32.939475 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.939750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.940020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] PATH_INFO: `/v3/projects/ad1d617abef24eefbd2247f88b1e81c3/users/0bb5f69056824a559c0b021d68eb00de/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:32.956541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1d617abef24eefbd2247f88b1e81c3, user_id=0bb5f69056824a559c0b021d68eb00de, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:32.959182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:32.967521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:32.972389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1339/2703] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:32 2022] PUT /identity/v3/projects/ad1d617abef24eefbd2247f88b1e81c3/users/0bb5f69056824a559c0b021d68eb00de/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:32.984470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:32.984796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:32.985064 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.013408 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] MFA Rules not processed for user `0bb5f69056824a559c0b021d68eb00de`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:33.014604 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:33.018521 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:33.079628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1365/2704] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:33.084407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.145300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a607-8a61-4ddd-aa69-b45ce920bbbf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.149794 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.150384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.150658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.150926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.151542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.153441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.180265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1340/2705] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:33 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:33.184336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.194982 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75e780-bc45-489b-b62e-7b07543a8a80 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.250456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.251049 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.251323 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.251588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.252194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.254806 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.275781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1366/2706] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:33 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:33.279864 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.290352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6071d-dacf-4775-a7be-c29bfb343c1d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.294946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.295535 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.295814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.296081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.296749 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.298313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.309040 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1341/2707] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:33.313229 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.323553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725a42-9649-4e73-a55b-f7cef12629c5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.328085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.328752 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.329029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.329299 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] PATH_INFO: `/v3/projects/c126ef22062d46b1852235a97d7ebd72/users/4e0be9fca81f4315bb561b06ef9937b1/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.345246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c126ef22062d46b1852235a97d7ebd72, user_id=4e0be9fca81f4315bb561b06ef9937b1, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.347970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.360217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1367/2708] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:33 2022] PUT /identity/v3/projects/c126ef22062d46b1852235a97d7ebd72/users/4e0be9fca81f4315bb561b06ef9937b1/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:33.364257 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.374018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7963a9-e61d-4308-8fc9-a166bb61ed99 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.433178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.433718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.433974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.434241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.434871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.436435 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5cb09-d23f-428c-83a4-ecc04a7e8ad5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.446473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1342/2709] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:33.450721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.461394 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc76ff-dcee-453c-a02b-ba1d0625c014 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.467368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.468123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.468388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.468681 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] PATH_INFO: `/v3/projects/c126ef22062d46b1852235a97d7ebd72/users/4e0be9fca81f4315bb561b06ef9937b1/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.470569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c126ef22062d46b1852235a97d7ebd72, user_id=4e0be9fca81f4315bb561b06ef9937b1, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.474032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.486692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1368/2710] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:33 2022] PUT /identity/v3/projects/c126ef22062d46b1852235a97d7ebd72/users/4e0be9fca81f4315bb561b06ef9937b1/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:33.499669 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.499984 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.500259 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.528483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] MFA Rules not processed for user `4e0be9fca81f4315bb561b06ef9937b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:33.529715 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:33.588084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:33.598334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1343/2711] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:33.608934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:33.610588 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:33.667718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c124-06d4-4631-af37-4250d73dab28 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:33.671237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:33.671851 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:33.672142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:33.672406 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:33.682120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:33.683565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:33.688358 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:33.694105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1369/2712] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:34.202160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:34.203607 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:34.215666 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939314ab-206b-4784-ab66-b63a14a0b9e0 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:34.219151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:34.219740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:34.220015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:34.220283 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:34.277668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:34.279100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:34.288349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1344/2713] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:38.358393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:38.367452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500b3a-3ca8-47c7-847f-f709cc29df43 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:38.371012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:38.371586 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:38.371859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:38.372122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:38.427085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:38.428501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5495-4815-432c-b1d2-2358b7602c84 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:38.437380 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1370/2714] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:40.523260 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:40.587335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da4a2-d4e7-4774-bd31-3ebda4bfbdec service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:40.591893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:40.592514 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:40.592827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:40.593098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] PATH_INFO: `/v3/users/225b80900a7143df9821007bcb3f3ce6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:40.594229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225b80900a7143df9821007bcb3f3ce6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:40.596126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:40.641554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225b80900a7143df9821007bcb3f3ce6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:40.648416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225b80900a7143df9821007bcb3f3ce6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:40.660599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225b80900a7143df9821007bcb3f3ce6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:40.661277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225b80900a7143df9821007bcb3f3ce6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:40.661875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225b80900a7143df9821007bcb3f3ce6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:40.673834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1345/2715] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:40 2022] DELETE /identity/v3/users/225b80900a7143df9821007bcb3f3ce6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:40.679165 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:40.679642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:40.679742 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:40.698448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:40.699636 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:40.756972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1371/2716] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:40.766754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:40.768246 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:40.782499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:40.827439 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137225a-891c-4196-b8a2-fc565f8ab662 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:40.831588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:40.832195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:40.832474 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:40.832775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:40.841673 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:40.843112 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:40.853510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1346/2717] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:41.130277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:41.131869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:41.146718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a63a04-f129-4e90-b4cc-2ff5fa24798c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:41.151398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:41.152022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:41.152295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:41.152563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] PATH_INFO: `/v3/projects/49e22508d393432b8c642dd0ac3ab5ad` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:41.153738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e22508d393432b8c642dd0ac3ab5ad)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:41.155691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:41.202246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e22508d393432b8c642dd0ac3ab5ad', 'request_id': 'req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.209398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e22508d393432b8c642dd0ac3ab5ad', 'request_id': 'req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.215159 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e22508d393432b8c642dd0ac3ab5ad', 'request_id': 'req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.229290 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] The token cache is being invalidate because project 49e22508d393432b8c642dd0ac3ab5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:41.229577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.230196 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.231689 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1372/2718] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:41 2022] DELETE /identity/v3/projects/49e22508d393432b8c642dd0ac3ab5ad => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:41.235835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:41.245796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed080c-1c1a-4faa-8476-7ee5a7b77887 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:41.302315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:41.302975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:41.303279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:41.303551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] PATH_INFO: `/v3/users/0bb5f69056824a559c0b021d68eb00de` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:41.304753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb5f69056824a559c0b021d68eb00de)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:41.306849 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:41.354169 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb5f69056824a559c0b021d68eb00de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.361125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb5f69056824a559c0b021d68eb00de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.373149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb5f69056824a559c0b021d68eb00de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.373821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb5f69056824a559c0b021d68eb00de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.374682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb5f69056824a559c0b021d68eb00de'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.387599 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1347/2719] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:41 2022] DELETE /identity/v3/users/0bb5f69056824a559c0b021d68eb00de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:41.657705 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:41.660565 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:41.676296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a903-51f4-4a45-8fd3-91c44bb4c4bc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:41.695630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:41.734132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:41.734751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:41.735027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:41.735296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] PATH_INFO: `/v3/projects/ad1d617abef24eefbd2247f88b1e81c3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:41.736392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1d617abef24eefbd2247f88b1e81c3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:41.738868 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:41.783921 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1d617abef24eefbd2247f88b1e81c3', 'request_id': 'req-1845bbe2-b38e-4ec5-91ca-a266ee21344c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.790139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1d617abef24eefbd2247f88b1e81c3', 'request_id': 'req-1845bbe2-b38e-4ec5-91ca-a266ee21344c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.795602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1d617abef24eefbd2247f88b1e81c3', 'request_id': 'req-1845bbe2-b38e-4ec5-91ca-a266ee21344c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.808145 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] The token cache is being invalidate because project ad1d617abef24eefbd2247f88b1e81c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:41.808438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.809111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.810646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1373/2720] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:41 2022] DELETE /identity/v3/projects/ad1d617abef24eefbd2247f88b1e81c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:41.814602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:41.817099 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:41.829591 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5ee39-3ad1-4d65-bf52-5744cc8b7866 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:41.863301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:41.891704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:41.892331 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:41.892635 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:41.892909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] PATH_INFO: `/v3/users/4e0be9fca81f4315bb561b06ef9937b1` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:41.894080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0be9fca81f4315bb561b06ef9937b1)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:41.895991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:41.944660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0be9fca81f4315bb561b06ef9937b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.952330 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0be9fca81f4315bb561b06ef9937b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.964237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0be9fca81f4315bb561b06ef9937b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.964964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0be9fca81f4315bb561b06ef9937b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.965566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-93dd6cb0-5288-4ef0-bc07-4f59b3de9c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0be9fca81f4315bb561b06ef9937b1'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:41.978691 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1348/2721] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:41 2022] DELETE /identity/v3/users/4e0be9fca81f4315bb561b06ef9937b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:42.261005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.262624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:42.279879 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845bbe2-b38e-4ec5-91ca-a266ee21344c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.336684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.337307 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.337577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.337840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] PATH_INFO: `/v3/projects/c126ef22062d46b1852235a97d7ebd72` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.338937 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c126ef22062d46b1852235a97d7ebd72)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.340828 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.385600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c126ef22062d46b1852235a97d7ebd72', 'request_id': 'req-19bee0ec-97ac-4f86-95d9-0efc73aa134e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:42.391461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c126ef22062d46b1852235a97d7ebd72', 'request_id': 'req-19bee0ec-97ac-4f86-95d9-0efc73aa134e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:42.392641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:42.398473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c126ef22062d46b1852235a97d7ebd72', 'request_id': 'req-19bee0ec-97ac-4f86-95d9-0efc73aa134e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:42.411317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] The token cache is being invalidate because project c126ef22062d46b1852235a97d7ebd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:42.411610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:42.412230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-19bee0ec-97ac-4f86-95d9-0efc73aa134e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:42.413769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1374/2722] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:42 2022] DELETE /identity/v3/projects/c126ef22062d46b1852235a97d7ebd72 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:42.419796 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.420080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.420348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.440874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:42.442049 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:42.504907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1349/2723] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:42.514781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.515085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.515346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.536281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:42.537530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:42.545440 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1375/2724] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:42.550209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.560072 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54bd3-00fe-4e30-a2b1-1406ffce2882 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.564702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.566433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.566709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.566975 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.567622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:42.567922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.569578 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.585062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1350/2725] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:42.589469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.598774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d77f1-a8d1-4115-87d7-cc830192df5e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.603388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.603969 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.604247 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.604514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.605199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.607050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.645112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1376/2726] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:42.649241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.659622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905fba2-77ea-4150-a228-6f3329fa6480 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.699566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:42.718163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.718762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.719043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.719315 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.719926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.722569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.743483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1351/2727] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:42.747570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.758315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541792a-9685-4a09-a2c7-7ae4cddf421a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.763234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.763830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.764108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.764421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.765091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.766668 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.777947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1377/2728] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:42.782026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.792321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd9e45-82aa-4167-89fe-292d17e1853a admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.797123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.797711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.797985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.798252 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.798915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.801482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff9ceb-771c-4dde-a73d-4ac9d29a4534 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.812194 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1352/2729] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:35:42.817413 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:42.831289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5993-2266-4cfc-a998-dadceb562a29 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:42.836376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:42.837066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.837346 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.837619 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] PATH_INFO: `/v3/projects/cb4c406777ce44ba90c600201e15bdbb/users/51b66cfa3868430baa2a6347b0cd401e/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.853717 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4c406777ce44ba90c600201e15bdbb, user_id=51b66cfa3868430baa2a6347b0cd401e, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:42.856351 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:42.869830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1378/2730] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:42 2022] PUT /identity/v3/projects/cb4c406777ce44ba90c600201e15bdbb/users/51b66cfa3868430baa2a6347b0cd401e/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:42.881717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:42.882213 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:42.882321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:42.909894 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] MFA Rules not processed for user `51b66cfa3868430baa2a6347b0cd401e`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:42.911002 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:42.976704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1353/2731] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:42.981201 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.042643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5392b-b22e-438b-a654-32de4c1ad15f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.047324 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.047917 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.048197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.048469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.049138 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.051388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.077388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1379/2732] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:42 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:43.082297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.092665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07f1a5-7752-481b-809d-33aed0e874bc None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.148409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.149043 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.149326 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.149598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.150231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.152123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.172971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1354/2733] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:43 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:43.177553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.187545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008c99-41bb-4ad3-9afb-55e305b8e401 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.192287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.192899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.193178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.193446 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.194097 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.195653 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.206490 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1380/2734] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:43.210680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.220848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b0d1-2496-46f4-855e-17124ff0879d admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.226215 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.226888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.227191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.227521 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] PATH_INFO: `/v3/projects/c67896f46b87458aac6221a39a0e8df1/users/bf48bdb966104d68bed936f1847f0018/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.242903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67896f46b87458aac6221a39a0e8df1, user_id=bf48bdb966104d68bed936f1847f0018, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.245574 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.258494 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1355/2735] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:43 2022] PUT /identity/v3/projects/c67896f46b87458aac6221a39a0e8df1/users/bf48bdb966104d68bed936f1847f0018/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:43.262407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.273524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99283e-c419-4f6c-9a0a-028e8405a581 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.323696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:43.340184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.340843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.341119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.341386 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.342013 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.343572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778d7b-9d53-4739-bee6-0a6d73960e49 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.353886 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1381/2736] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:43.358027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.368347 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb19833-e9fd-41d1-8d30-fd94d983c00b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.373143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.373784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.374310 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.374575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] PATH_INFO: `/v3/projects/c67896f46b87458aac6221a39a0e8df1/users/bf48bdb966104d68bed936f1847f0018/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.376453 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67896f46b87458aac6221a39a0e8df1, user_id=bf48bdb966104d68bed936f1847f0018, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.379378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.389162 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1356/2737] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:43 2022] PUT /identity/v3/projects/c67896f46b87458aac6221a39a0e8df1/users/bf48bdb966104d68bed936f1847f0018/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:43.400214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.400493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.400813 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.429114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] MFA Rules not processed for user `bf48bdb966104d68bed936f1847f0018`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:43.430250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:43.496959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1382/2738] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:43.508871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.510561 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:43.515798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:43.569190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36a540-b076-4543-9cfe-c59a44a3c8f7 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.572752 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.573344 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.573618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.573884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.583032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.584436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.593537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1357/2739] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:43.697417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:43.707577 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf79a-dc5a-4d2c-88cf-44835d036473 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:43.711169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:43.711758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:43.712037 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:43.712309 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:43.767473 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:43.769576 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213016d4-8e4d-4f5f-b1ff-31098259cf93 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:43.778398 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1383/2740] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:46.368929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:46.428811 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628caac0-ce31-427b-9a31-e4305ee4738d service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:46.433101 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:46.433708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:46.433980 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:46.434247 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] PATH_INFO: `/v3/users/51b66cfa3868430baa2a6347b0cd401e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:46.435340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b66cfa3868430baa2a6347b0cd401e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:46.437277 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:46.482063 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b66cfa3868430baa2a6347b0cd401e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:46.489617 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b66cfa3868430baa2a6347b0cd401e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:46.501524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b66cfa3868430baa2a6347b0cd401e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:46.502181 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b66cfa3868430baa2a6347b0cd401e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:46.502784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b66cfa3868430baa2a6347b0cd401e'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:46.515042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1358/2741] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:46 2022] DELETE /identity/v3/users/51b66cfa3868430baa2a6347b0cd401e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:46.519531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710627-b758-4aac-b818-feafe378e921 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:46.519992 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710627-b758-4aac-b818-feafe378e921 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:46.520255 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710627-b758-4aac-b818-feafe378e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:46.538876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e2710627-b758-4aac-b818-feafe378e921 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:46.540066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e2710627-b758-4aac-b818-feafe378e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:46.598531 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1384/2742] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:46.608197 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:46.609644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:46.639172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:46.671774 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d931-a152-4821-9eef-01e6f08a820b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:46.676438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:46.677081 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:46.677361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:46.677628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:46.686603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:46.687994 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:46.697789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1359/2743] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:46.967312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2710627-b758-4aac-b818-feafe378e921 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:46.968904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e2710627-b758-4aac-b818-feafe378e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:46.978239 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:46.982384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2710627-b758-4aac-b818-feafe378e921 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:46.987744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:46.988673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:46.988958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:46.989379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] PATH_INFO: `/v3/projects/cb4c406777ce44ba90c600201e15bdbb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:46.990551 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4c406777ce44ba90c600201e15bdbb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:46.992493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.048811 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4c406777ce44ba90c600201e15bdbb', 'request_id': 'req-c880fdee-47f1-47f2-8d17-db0375ea797a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.056059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4c406777ce44ba90c600201e15bdbb', 'request_id': 'req-c880fdee-47f1-47f2-8d17-db0375ea797a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.061628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4c406777ce44ba90c600201e15bdbb', 'request_id': 'req-c880fdee-47f1-47f2-8d17-db0375ea797a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.074194 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] The token cache is being invalidate because project cb4c406777ce44ba90c600201e15bdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:47.074476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.075087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.076543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1385/2744] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:46 2022] DELETE /identity/v3/projects/cb4c406777ce44ba90c600201e15bdbb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:47.080719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.090862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad308b-01a4-4aa5-9577-b572ab56923d service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.147570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.148245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.148565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.148926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] PATH_INFO: `/v3/users/bf48bdb966104d68bed936f1847f0018` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.150150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf48bdb966104d68bed936f1847f0018)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.152245 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.198070 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf48bdb966104d68bed936f1847f0018'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.204956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf48bdb966104d68bed936f1847f0018'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.217693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf48bdb966104d68bed936f1847f0018'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.218408 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf48bdb966104d68bed936f1847f0018'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.219006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-136a0c07-b61a-460b-a843-11f85ab3982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf48bdb966104d68bed936f1847f0018'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.232948 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1360/2745] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:47 2022] DELETE /identity/v3/users/bf48bdb966104d68bed936f1847f0018 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:47.497492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.499272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:47.514569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880fdee-47f1-47f2-8d17-db0375ea797a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.573234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.573902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.574116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.574383 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] PATH_INFO: `/v3/projects/c67896f46b87458aac6221a39a0e8df1` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.575472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67896f46b87458aac6221a39a0e8df1)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.577396 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.625708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67896f46b87458aac6221a39a0e8df1', 'request_id': 'req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.632911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67896f46b87458aac6221a39a0e8df1', 'request_id': 'req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.638483 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67896f46b87458aac6221a39a0e8df1', 'request_id': 'req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.652022 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] The token cache is being invalidate because project c67896f46b87458aac6221a39a0e8df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:47.652311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.652958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-b79f8d04-cb77-4d8a-b345-b667a7ed13f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:47.654437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1386/2746] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:47 2022] DELETE /identity/v3/projects/c67896f46b87458aac6221a39a0e8df1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:47.659396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.659876 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.659982 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.679425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:47.680627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:47.720711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:47.739250 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1361/2747] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:47.747040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.747262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.747530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.767417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:47.768614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:47.776630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1387/2748] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:47.780784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.790255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490fc9b-e677-450e-9890-9941c3c07f54 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.794753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.795341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.795616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.795882 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.796551 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:47.796877 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.798447 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.810062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1362/2749] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:47.814144 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.823842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7743c-2e75-4853-942e-c4ff1382d465 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.828356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.828962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.829236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.829505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.830124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.831961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.841172 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:47.859409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1388/2750] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:47 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:47.864653 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.874891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0119642-88f0-4788-ac69-9458cbc28507 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.930168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.930762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.931037 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.931302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.931925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.933847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.954341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1363/2751] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:47 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:47.959018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:47.969652 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d6c6-ee62-47d4-83ec-7e939e72c6a9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:47.974243 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:47.974845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:47.975117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:47.975377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:47.976006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:47.977600 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:47.987367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1389/2752] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:35:47.992243 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.002384 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252c97-ca79-45a6-9b78-c45998f2fad4 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.007608 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.008193 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.008469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.008764 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.009394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.010962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d071b-b741-4ebe-9f2c-e0bccc3d3a32 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.021373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1364/2753] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:48.025456 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.035119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d09c-3985-4524-b380-6f76b8a325d1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.040240 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.040908 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.041294 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.041485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] PATH_INFO: `/v3/projects/b67e21b4d5174060aa0e35583cff39e0/users/4bcaa445cbce4e588c687f90cd7332d2/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.056902 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67e21b4d5174060aa0e35583cff39e0, user_id=4bcaa445cbce4e588c687f90cd7332d2, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.059538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.072900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1390/2754] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:48 2022] PUT /identity/v3/projects/b67e21b4d5174060aa0e35583cff39e0/users/4bcaa445cbce4e588c687f90cd7332d2/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:48.083042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.083350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.083630 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.111718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] MFA Rules not processed for user `4bcaa445cbce4e588c687f90cd7332d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:48.112968 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:48.177351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1365/2755] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:48.181810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.243223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad49c9-3187-4b78-9b53-f3e8a97d426c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.248011 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.248640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.249200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.249472 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.250092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.251997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.278426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1391/2756] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:48 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:48.282466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.293910 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50ca84-6b54-46a1-9bd4-1d50ee74a345 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.334055 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:48.351284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.351879 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.352150 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.352420 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.353062 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.354959 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.376293 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1366/2757] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:48 2022] POST /identity/v3/users => generated 310 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:35:48.380832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.391155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f4c4c-6f83-41e5-8e1d-b7f878991000 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.396417 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.397042 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.397318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.397582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.398205 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.399757 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.410054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1392/2758] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:48.414451 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.424371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0729b-d8d2-416e-9d2c-3b45f5da7d41 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.429699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.430336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.430611 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.430973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] PATH_INFO: `/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a/users/5fa5e579d718409b93b67689f0fb9947/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.446039 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6137eb688b4dbb8440cdd9b49d476a, user_id=5fa5e579d718409b93b67689f0fb9947, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.448718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.460970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1367/2759] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:48 2022] PUT /identity/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a/users/5fa5e579d718409b93b67689f0fb9947/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:48.464850 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.474549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103b8dc-40d5-4746-9734-f1fca6e8ec89 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.530379 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.530935 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.531272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.531614 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.532389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.534080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295a440-c2a5-41a9-9975-615ec69943a3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.543580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1393/2760] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:48.547700 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.558324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9ce56-80d9-497e-9b0f-12045a9dd3df admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.562881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.563547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.563824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.564095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] PATH_INFO: `/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a/users/5fa5e579d718409b93b67689f0fb9947/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.566019 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6137eb688b4dbb8440cdd9b49d476a, user_id=5fa5e579d718409b93b67689f0fb9947, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.569295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.579276 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1368/2761] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:48 2022] PUT /identity/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a/users/5fa5e579d718409b93b67689f0fb9947/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:48.645539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.645539 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.646254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.672761 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] MFA Rules not processed for user `5fa5e579d718409b93b67689f0fb9947`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:48.673960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:48.685873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:48.742414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1394/2762] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:48 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:48.753481 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:48.756004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:48.812374 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9edda-2aac-44ed-aecf-979ead8bf976 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:48.815983 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:48.816834 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:48.817266 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:48.817390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:48.826712 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:48.828144 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:48.838173 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1369/2763] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:35:48.991858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:49.001527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361b12-7d2a-4ee4-b0bb-f8226dbb81c4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:49.005843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:49.006422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:49.006694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:49.006956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:49.061502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:49.062964 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6bd22-b810-44a9-a0f3-9c3421c180a3 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:49.072104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1395/2764] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:54.329717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:54.390615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162c7-6298-4a06-b003-d9b43b6c6ea4 service cinder] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:54.395491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:54.396100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:54.396381 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:54.396675 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] PATH_INFO: `/v3/users/4bcaa445cbce4e588c687f90cd7332d2` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:54.397785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcaa445cbce4e588c687f90cd7332d2)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:54.399678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:54.440767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:54.447544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcaa445cbce4e588c687f90cd7332d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:54.454739 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcaa445cbce4e588c687f90cd7332d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:54.467212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcaa445cbce4e588c687f90cd7332d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:54.467881 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcaa445cbce4e588c687f90cd7332d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:54.468522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcaa445cbce4e588c687f90cd7332d2'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:54.482217 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1370/2765] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:54 2022] DELETE /identity/v3/users/4bcaa445cbce4e588c687f90cd7332d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:54.486946 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b68d16-6192-4409-bbad-b743f393366c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:54.487432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b68d16-6192-4409-bbad-b743f393366c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:54.487589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b68d16-6192-4409-bbad-b743f393366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:54.506766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-94b68d16-6192-4409-bbad-b743f393366c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:54.507943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94b68d16-6192-4409-bbad-b743f393366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:54.565125 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1396/2766] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:54.575237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:54.576650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:54.633861 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1657-72f6-43d7-bc85-6e2221617909 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:54.638553 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:54.639190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:54.639429 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:54.639704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:54.651032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:54.652463 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:54.662544 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1371/2767] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:35:54.925493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b68d16-6192-4409-bbad-b743f393366c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:54.927602 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94b68d16-6192-4409-bbad-b743f393366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:54.940311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b68d16-6192-4409-bbad-b743f393366c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:54.945257 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:54.945944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:54.946168 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:54.946422 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] PATH_INFO: `/v3/projects/b67e21b4d5174060aa0e35583cff39e0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:54.948055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67e21b4d5174060aa0e35583cff39e0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:54.949462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:54.994103 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:54.998012 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67e21b4d5174060aa0e35583cff39e0', 'request_id': 'req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.005017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67e21b4d5174060aa0e35583cff39e0', 'request_id': 'req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.010625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67e21b4d5174060aa0e35583cff39e0', 'request_id': 'req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.023478 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] The token cache is being invalidate because project b67e21b4d5174060aa0e35583cff39e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:55.023884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.024562 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.026120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1397/2768] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:54 2022] DELETE /identity/v3/projects/b67e21b4d5174060aa0e35583cff39e0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:55.030633 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.041335 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f77a6-2014-4984-9ea8-05a0d17663f0 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.098557 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.099199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.099473 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.099738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] PATH_INFO: `/v3/users/5fa5e579d718409b93b67689f0fb9947` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.100892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa5e579d718409b93b67689f0fb9947)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.102813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.151522 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa5e579d718409b93b67689f0fb9947'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.158465 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa5e579d718409b93b67689f0fb9947'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.163783 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:55.173511 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa5e579d718409b93b67689f0fb9947'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.174207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa5e579d718409b93b67689f0fb9947'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.174827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-2bbd525a-e645-49e2-9346-dec73ceba582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa5e579d718409b93b67689f0fb9947'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.188641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1372/2769] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:35:55 2022] DELETE /identity/v3/users/5fa5e579d718409b93b67689f0fb9947 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:55.450633 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.452105 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:55.465635 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bbb05-c3aa-40fd-9b8a-bd357c75d68a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.524961 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.525587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.525845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.526117 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] PATH_INFO: `/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.527212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6137eb688b4dbb8440cdd9b49d476a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.529113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.574972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6137eb688b4dbb8440cdd9b49d476a', 'request_id': 'req-e5e03430-c148-4b91-94ef-4d2dbf81fa47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.580931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6137eb688b4dbb8440cdd9b49d476a', 'request_id': 'req-e5e03430-c148-4b91-94ef-4d2dbf81fa47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.587005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6137eb688b4dbb8440cdd9b49d476a', 'request_id': 'req-e5e03430-c148-4b91-94ef-4d2dbf81fa47'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.599781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] The token cache is being invalidate because project 9b6137eb688b4dbb8440cdd9b49d476a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:35:55.600072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.600744 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e5e03430-c148-4b91-94ef-4d2dbf81fa47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:35:55.602215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1398/2770] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:35:55 2022] DELETE /identity/v3/projects/9b6137eb688b4dbb8440cdd9b49d476a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:35:55.607174 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.607624 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.607745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.627837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:55.629287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:55.688097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1373/2771] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:55.695840 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.696124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.696399 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.716402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:55.717553 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:55.726084 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1399/2772] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:55.730301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.740730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703c7f-920f-4740-af5b-261b841134b8 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.745324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.745914 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.746191 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.746460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.747103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:35:55.747407 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.749290 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.760685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1374/2773] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:35:55.764911 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.774688 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697c1c-2498-4642-a5ba-9b975b992871 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.779366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.779948 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.780224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.780494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.781140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.783004 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.810931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1400/2774] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:35:55 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:55.815153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.825234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18359537-c8db-464d-acbf-7c3154b5a351 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.881730 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.882329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.882615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.882891 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.883536 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.885549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.906124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1375/2775] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:35:55 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:35:55.911333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.921488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fae1-c986-4da9-828f-535c54ae56d0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.926690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.927283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.927558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.927824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.928451 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.930055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.939834 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1401/2776] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:55.944060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.954504 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9663-da7e-435d-a235-8b2ba240d8ef admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:55.960066 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:55.960698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:55.960973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:55.961239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:55.961871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:55.963467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c180d9-5b1e-497b-97fa-8cd2bd0db3a8 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:55.975549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1376/2777] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:35:55.979607 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:55.989582 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93643-4d22-4658-b036-2fcab6f9919b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:56.009331 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:56.009970 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:56.010244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:56.010511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] PATH_INFO: `/v3/projects/d9ad8d803bf940f28d59eb8bcbfd5175/users/4b48dc57879540cda78f87553d6b0941/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:56.033409 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ad8d803bf940f28d59eb8bcbfd5175, user_id=4b48dc57879540cda78f87553d6b0941, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:56.036843 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:56.045087 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:56.054980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1402/2778] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:35:55 2022] PUT /identity/v3/projects/d9ad8d803bf940f28d59eb8bcbfd5175/users/4b48dc57879540cda78f87553d6b0941/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:35:56.065222 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:56.065510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:56.065785 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:56.093306 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] MFA Rules not processed for user `4b48dc57879540cda78f87553d6b0941`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:35:56.094516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:56.127431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:56.160807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1377/2779] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:35:56.172599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:35:56.174329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:35:56.230771 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b162-45ad-425e-b121-787fa225b948 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:35:56.234274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:35:56.234872 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:35:56.235146 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:35:56.235412 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:35:56.243866 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:35:56.245291 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ab6b5-1808-4b75-9773-4877d3a24065 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:35:56.254750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1403/2780] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:06.157314 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=12 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:06.250095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=27 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:14.940151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.003923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961439c-5de2-499a-8f4a-d0e10b0a5f93 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.008815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.009433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.009710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.009979 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] PATH_INFO: `/v3/users/4b48dc57879540cda78f87553d6b0941` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.011084 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b48dc57879540cda78f87553d6b0941)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.013017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.059461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b48dc57879540cda78f87553d6b0941'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.066770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b48dc57879540cda78f87553d6b0941'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.078769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b48dc57879540cda78f87553d6b0941'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.079437 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b48dc57879540cda78f87553d6b0941'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.080035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b48dc57879540cda78f87553d6b0941'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.092353 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1378/2781] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:36:14 2022] DELETE /identity/v3/users/4b48dc57879540cda78f87553d6b0941 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:15.096945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.097443 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.097543 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.117567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:15.118739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:15.175678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1404/2782] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:15.185767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.187240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:15.244689 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b3314-9a37-45f3-bb6c-707a81b49de3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.248754 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.249364 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.249645 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.249915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.259678 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.261221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a10b01-ca6f-4dde-bc20-c5e487dea274 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.270988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1379/2783] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:15.548206 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.549696 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:15.561622 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419326b-1e3a-4bb0-8b74-66ca3bbd8e31 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.566465 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.567086 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.567364 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.567637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] PATH_INFO: `/v3/projects/d9ad8d803bf940f28d59eb8bcbfd5175` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.571439 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ad8d803bf940f28d59eb8bcbfd5175)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.573374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.622279 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ad8d803bf940f28d59eb8bcbfd5175', 'request_id': 'req-948aafb2-db63-425b-be8b-dd6c2b414044'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.628711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ad8d803bf940f28d59eb8bcbfd5175', 'request_id': 'req-948aafb2-db63-425b-be8b-dd6c2b414044'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.634476 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ad8d803bf940f28d59eb8bcbfd5175', 'request_id': 'req-948aafb2-db63-425b-be8b-dd6c2b414044'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.647330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] The token cache is being invalidate because project d9ad8d803bf940f28d59eb8bcbfd5175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:36:15.647625 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.648305 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-948aafb2-db63-425b-be8b-dd6c2b414044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:15.649823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1405/2784] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:36:15 2022] DELETE /identity/v3/projects/d9ad8d803bf940f28d59eb8bcbfd5175 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:15.654660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.654942 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.655209 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.675180 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:15.676409 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:15.693104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:15.737042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1380/2785] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:15.744641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.744928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.745198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.765803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:15.766997 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:15.776153 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1406/2786] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:15.780340 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.790346 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cbde-c2b8-401a-9c6f-e05f9044d7c7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.794977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.795571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.795850 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.796121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.796801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:36:15.797106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.798723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.810349 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1381/2787] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:36:15.814593 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.824685 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc762c3e-34f9-4a17-a98b-28a9a209fa82 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.829315 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.829892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.830200 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.830469 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.831081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.833020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.861124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1407/2788] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:36:15 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:36:15.865279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.875779 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb286c-e9f3-43c2-9f72-e8db2723bd52 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.931970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.932485 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.932798 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.933200 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.933821 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.935709 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.957369 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1382/2789] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:36:15 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:36:15.962212 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:15.972366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f49bb-c1ea-4e69-a960-f6098b2fc27b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:15.977026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:15.977603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:15.977877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:15.978142 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:15.978767 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:15.980327 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:15.990067 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1408/2790] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:15.994051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:16.004214 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052f67-cca0-4bae-b9e3-592110d9abb3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:16.009401 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:16.009990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:16.010271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:16.010543 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:16.011179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:16.012799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c753a4-e9fa-48eb-8633-35f24e041d36 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:16.024061 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1383/2791] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:16.028063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:16.037807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276fc1-ac90-46b2-99a5-f05e6e70a837 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:16.042402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:16.043029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:16.043303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:16.043569 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] PATH_INFO: `/v3/projects/9648eed39a7b44e69db3dad33269af2e/users/001e5ce1393c4f70aa0a6f28057d2887/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:16.058560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9648eed39a7b44e69db3dad33269af2e, user_id=001e5ce1393c4f70aa0a6f28057d2887, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:16.061292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:16.074546 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1409/2792] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:36:16 2022] PUT /identity/v3/projects/9648eed39a7b44e69db3dad33269af2e/users/001e5ce1393c4f70aa0a6f28057d2887/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:16.084958 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8092a-c346-4e24-86af-cd90abf460a4 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:16.085249 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8092a-c346-4e24-86af-cd90abf460a4 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:16.085524 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8092a-c346-4e24-86af-cd90abf460a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:16.112570 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f3b8092a-c346-4e24-86af-cd90abf460a4 None None] MFA Rules not processed for user `001e5ce1393c4f70aa0a6f28057d2887`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:16.113805 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f3b8092a-c346-4e24-86af-cd90abf460a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:16.176468 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1384/2793] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:16.188114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:16.190642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:16.212643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:16.249903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ccb39-6d33-4ade-a477-7d250faf59e6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:16.253517 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:16.254123 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:16.254375 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:16.254640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:16.263163 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:16.264623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:16.273944 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1410/2794] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:17.636124 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:17.636699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:17.636812 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:17.657056 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] MFA Rules not processed for user `001e5ce1393c4f70aa0a6f28057d2887`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:17.658255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:17.666151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1385/2795] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:17.704789 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:17.706249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:17.762122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ca95-59d3-4e19-a6ee-68566b79c125 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:17.765678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:17.766262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:17.766537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:17.766800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:17.768564 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:17.838298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:17.839630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:17.851018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1411/2796] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:18.299021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:18.300833 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:18.325735 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:18.328220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:18.329235 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:18.388258 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0be69-41f4-44ed-9092-ccbf82b17903 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:18.390547 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a9f4-4d0d-4407-a89a-00dbd9bae9e6 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:18.391903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:18.392494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:18.392807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:18.393072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:18.394776 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:18.395671 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:18.396270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:18.396567 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:18.397044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:18.399240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:18.408548 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:18.409971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:18.410554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:18.412138 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a80974-5bd9-49cb-b06d-dec99aee511d service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:18.420784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1412/2797] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:18.423883 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1386/2798] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:20.275047 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:20.284505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cea69-6760-47c1-be44-2150b6231d10 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:20.289198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:20.289800 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:20.290080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:20.290352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:20.292109 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:20.298814 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:20.303714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:20.305632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:20.314766 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1413/2799] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:28.419342 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=27 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:30.310671 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:31.544291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:31.544858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:31.544858 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:31.563998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] MFA Rules not processed for user `5a306892d62443c598135dd717a3f04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:31.565272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:31.619651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1387/2800] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:31.971367 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:31.980507 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4d67-c367-4019-811a-871f8006a953 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:31.984074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:31.984679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:31.984952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:31.985215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:31.986891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:31.996160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:31.997591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3885a-3362-410a-857d-a4425224885e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:32.005525 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1414/2801] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:32.466026 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:32.467623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:32.479974 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d3cad-43e0-4754-ba7b-b1eb5faf0c41 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:32.483852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:32.484436 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:32.484746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:32.485015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:32.486750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:32.549967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:32.551415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:32.561683 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1388/2802] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:33.086447 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:33.086994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:33.086994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:33.137747 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:33.138977 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:33.204854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1415/2803] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:36:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:33.259471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:33.260960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:33.384303 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7d3f-a2fa-481a-9d65-387eb4f800b4 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:33.392270 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:33.392859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:33.393255 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:33.393529 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:33.405396 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:33.408944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bd83-2e18-4ff9-bab3-ccdbc67f6304 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:33.445799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1389/2804] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:36:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:36:33.596869 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:33.598575 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:33.624441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f9ae-7dde-4f72-88f3-35ae5688ebfd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:33.632714 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:33.633334 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:33.633628 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:33.633888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:33.636051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:33.656068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:33.658450 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:33.680006 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1416/2805] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:36:34.110701 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79958843-7b38-4519-8e82-c169e905ace9 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:34.111229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79958843-7b38-4519-8e82-c169e905ace9 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:34.111229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79958843-7b38-4519-8e82-c169e905ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:34.131195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-79958843-7b38-4519-8e82-c169e905ace9 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:34.132441 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-79958843-7b38-4519-8e82-c169e905ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:34.141010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1390/2806] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:36:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:34.155389 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:34.167690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7718d-9f66-4ade-9c46-6cba3d4b0c79 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:34.172647 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:34.173366 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:34.173646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:34.174051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:34.182589 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:34.184237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:34.192740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1417/2807] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:36:34.470086 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba7c6-9a04-4ec9-b27f-40cfae2dc139 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:34.470372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba7c6-9a04-4ec9-b27f-40cfae2dc139 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:34.470672 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba7c6-9a04-4ec9-b27f-40cfae2dc139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:34.486735 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:34.493491 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e4eba7c6-9a04-4ec9-b27f-40cfae2dc139 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:34.494724 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e4eba7c6-9a04-4ec9-b27f-40cfae2dc139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:34.502686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1391/2808] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:36:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:34.516107 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:34.527932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84622f-4dfa-48bf-bc2d-a8cfd37b1b0c service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:34.533234 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:34.534062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:34.534603 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:34.534995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:34.544287 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:34.546104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:34.555654 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1418/2809] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:36:34.947618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:34.947892 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:34.948165 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:34.968196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:34.969428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:34.977528 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1392/2810] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:36:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:34.990792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:35.002433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb77f9-72a6-4bcf-bb1b-61bc35567f11 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:35.008215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:35.008852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:35.009128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:35.009395 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:35.018275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:35.019826 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb117f-ddf8-4179-bb71-c13393baeedb service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:35.029303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1419/2811] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:36:37.414710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:37.480228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937c318-fcba-4818-86fd-e63ae4af9457 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:37.484966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:37.485595 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:37.485874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:37.486149 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] PATH_INFO: `/v3/users/001e5ce1393c4f70aa0a6f28057d2887` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:37.487297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001e5ce1393c4f70aa0a6f28057d2887)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:37.489256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:37.534638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001e5ce1393c4f70aa0a6f28057d2887'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:37.542102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001e5ce1393c4f70aa0a6f28057d2887'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:37.554562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001e5ce1393c4f70aa0a6f28057d2887'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:37.555236 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001e5ce1393c4f70aa0a6f28057d2887'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:37.555847 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001e5ce1393c4f70aa0a6f28057d2887'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:37.568763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1393/2812] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:36:37 2022] DELETE /identity/v3/users/001e5ce1393c4f70aa0a6f28057d2887 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:36:37.573312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:37.573837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:37.573837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:37.592945 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:37.594083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:37.659282 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1420/2813] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:37.669320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:37.670799 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:37.730580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0667d2a-a239-482b-ab00-bbfc5e36f766 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:37.734651 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:37.735254 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:37.735526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:37.735993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:37.746410 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:37.747871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:37.758142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1394/2814] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:37.875134 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:37.886341 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada9c2-2d32-41b5-8e75-f8b17716a0c7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:37.893956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:37.894694 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:37.894956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:37.895244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:37.897559 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:37.906357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:37.911262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:37.912916 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16904-7d08-4b2c-bf4f-ee8eda64a7a0 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:37.922968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1421/2815] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:37.964234 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:37.965706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:37.981088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752592-4578-4885-b268-ae596f5cffd7 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:37.986159 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:37.986817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:37.987094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:37.987361 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] PATH_INFO: `/v3/projects/9648eed39a7b44e69db3dad33269af2e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:37.988618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9648eed39a7b44e69db3dad33269af2e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:37.991242 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.004161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:38.047527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9648eed39a7b44e69db3dad33269af2e', 'request_id': 'req-4f791d23-6505-4588-a94c-4ae10583fcc6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:38.055965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9648eed39a7b44e69db3dad33269af2e', 'request_id': 'req-4f791d23-6505-4588-a94c-4ae10583fcc6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:38.062640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9648eed39a7b44e69db3dad33269af2e', 'request_id': 'req-4f791d23-6505-4588-a94c-4ae10583fcc6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:38.074080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] The token cache is being invalidate because project 9648eed39a7b44e69db3dad33269af2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:36:38.074359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:38.075017 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-4f791d23-6505-4588-a94c-4ae10583fcc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:38.076510 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1395/2816] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:36:37 2022] DELETE /identity/v3/projects/9648eed39a7b44e69db3dad33269af2e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:38.081610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.081891 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.082157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.102095 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:38.103222 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:38.165043 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1422/2817] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:36:38.172563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.172875 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.173147 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.194093 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:38.199600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:38.207843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1396/2818] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:38.220407 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.230924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c71d-88a1-4c88-8681-70eb325d9917 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.235956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.236550 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.236861 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.237132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.237778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:36:38.238079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.240293 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.252414 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1423/2819] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:36:38.257758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.267221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6c021-ea3c-403f-aa0f-785cfa9fb24c None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.272817 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.273418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.273690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.273951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.274566 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.276499 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.303498 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1397/2820] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:36:38 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:36:38.307751 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.325887 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0287ba-3847-484c-bf46-14fafb7db6c3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.386740 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.387251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.387529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.387801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.388502 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.390435 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.413033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1424/2821] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:36:38 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:36:38.417060 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.427554 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62b27-8441-49ed-9189-7eeafd31d2d9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.432143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.432801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.433085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.433355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.433996 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.435615 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.446507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1398/2822] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:38.450359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.460963 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d23d2-ac74-4c33-a50d-eab9f6522fff admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.465723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.466312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.466587 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.466854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.467536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.469171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ff79-5da8-45fd-8555-dfc2685b3e59 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.480497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1425/2823] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:38.484562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.494492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a961b34-3e4b-4916-a2e0-8aa33341bde6 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.499339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.499986 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.500262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.500531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] PATH_INFO: `/v3/projects/4fb0d2e9c3544096a745fc1ea013db12/users/dbe848ebaca542e798f078f6dac8d284/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.517272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb0d2e9c3544096a745fc1ea013db12, user_id=dbe848ebaca542e798f078f6dac8d284, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.519797 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.540842 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1399/2824] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:36:38 2022] PUT /identity/v3/projects/4fb0d2e9c3544096a745fc1ea013db12/users/dbe848ebaca542e798f078f6dac8d284/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:38.545929 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9624e4-9d62-4518-b69e-ea8440536d2a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.546278 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9624e4-9d62-4518-b69e-ea8440536d2a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.546616 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9624e4-9d62-4518-b69e-ea8440536d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.568880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ea9624e4-9d62-4518-b69e-ea8440536d2a None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:38.570192 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ea9624e4-9d62-4518-b69e-ea8440536d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:38.627922 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:38.642036 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1426/2825] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:36:38.649884 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:38.651784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:38.712097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045100-88f2-4792-a6dc-2ecfe5a7f436 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:38.715756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:38.716358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:38.716664 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:38.716964 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:38.726466 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:38.728033 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:38.738105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1400/2826] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:44.504289 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:44.504858 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:44.504952 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:44.535489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] MFA Rules not processed for user `dbe848ebaca542e798f078f6dac8d284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:44.537429 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:44.700333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1427/2827] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:44.706606 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:44.731348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abb74-1807-44fc-9152-12e660c0e972 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:44.741946 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:44.742708 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:44.743025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:44.743291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:44.745378 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:44.747603 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:44.791660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1401/2828] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:36:44.796684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:44.816594 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7d7c1-b363-46f1-b551-cbc95cffe2ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:44.905573 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:44.906311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:44.906690 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:44.907096 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:44.907893 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:44.909975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:44.990437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1428/2829] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:36:44 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:36:44.994793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:45.010941 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841dc6-680c-4036-8494-fcfd5f6e4928 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:45.020773 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:45.021971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:45.022461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:45.022908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:45.024937 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:45.029423 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:45.052622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1402/2830] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:45.054880 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:45.066112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ca59-4087-4e90-9975-1d7612268ff2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:45.072015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:45.072329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:45.072645 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:45.072924 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] PATH_INFO: `/v3/projects/92eadf25a65a46c9987a5515b29ff4d5/users/6641b5ca706c4621812aad8450891ae7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:45.089410 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92eadf25a65a46c9987a5515b29ff4d5, user_id=6641b5ca706c4621812aad8450891ae7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:45.092076 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:45.119545 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1429/2831] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:36:45 2022] PUT /identity/v3/projects/92eadf25a65a46c9987a5515b29ff4d5/users/6641b5ca706c4621812aad8450891ae7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:45.120621 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:45.136324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:45.144696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c438a-cecc-462e-8f5a-5facf04e2257 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:45.249318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:45.249944 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:45.250221 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:45.251336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:45.251998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:45.254078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:45.266807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1403/2832] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:36:45.272641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:45.292062 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b451a-6f89-4b8a-9674-d78d304a7c16 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:45.306023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:45.306711 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:45.306991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:45.307264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] PATH_INFO: `/v3/projects/92eadf25a65a46c9987a5515b29ff4d5/users/6641b5ca706c4621812aad8450891ae7/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:45.312083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=92eadf25a65a46c9987a5515b29ff4d5, user_id=6641b5ca706c4621812aad8450891ae7, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:45.320831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:45.347745 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1430/2833] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:36:45 2022] PUT /identity/v3/projects/92eadf25a65a46c9987a5515b29ff4d5/users/6641b5ca706c4621812aad8450891ae7/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:46.996915 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:46.998969 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:47.136354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:47.138329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:47.174127 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9570-b0d3-4416-b904-1cf46aea5fc0 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:47.199876 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:47.224994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f4145-c7e4-40fd-b744-18122c242bcf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:47.234132 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:47.235055 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:47.235370 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:47.235641 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] PATH_INFO: `/v3/users/9de93f11094b4e00ad8b9ba635c21ef0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:47.237368 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de93f11094b4e00ad8b9ba635c21ef0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:47.240663 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:47.301399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:47.303011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:47.303704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:47.304304 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:47.306711 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:47.338382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:47.340685 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:47.354204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de93f11094b4e00ad8b9ba635c21ef0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.355292 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de93f11094b4e00ad8b9ba635c21ef0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.360155 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1404/2834] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:47.375637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de93f11094b4e00ad8b9ba635c21ef0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.403197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de93f11094b4e00ad8b9ba635c21ef0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.404207 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de93f11094b4e00ad8b9ba635c21ef0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.420526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1431/2835] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:36:47 2022] DELETE /identity/v3/users/9de93f11094b4e00ad8b9ba635c21ef0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:47.646195 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:47.662493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d57d-5b3c-49fc-89f0-0664f10b116c service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:47.730513 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=100 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:47.771826 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:47.772852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:47.773126 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:47.773495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] PATH_INFO: `/v3/projects/060100a588064b2eb29049d245ada430` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:47.774920 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060100a588064b2eb29049d245ada430)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:47.777082 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:47.843116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060100a588064b2eb29049d245ada430', 'request_id': 'req-ac2f935f-24a4-464a-af77-5e8333f59e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.853704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060100a588064b2eb29049d245ada430', 'request_id': 'req-ac2f935f-24a4-464a-af77-5e8333f59e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.861228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060100a588064b2eb29049d245ada430', 'request_id': 'req-ac2f935f-24a4-464a-af77-5e8333f59e64'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.873759 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] The token cache is being invalidate because project 060100a588064b2eb29049d245ada430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:36:47.873962 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.874484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:47.877011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1405/2836] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:36:47 2022] DELETE /identity/v3/projects/060100a588064b2eb29049d245ada430 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:47.880774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:47.882218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:47.908999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd39d0-d4b5-4cac-a428-53fda6846f77 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:48.009807 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:48.011098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:48.011098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:48.011661 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] PATH_INFO: `/v3/users/83d847b534c046a7904af4cf0fcdd506` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:48.015393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d847b534c046a7904af4cf0fcdd506)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:48.017552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:48.105646 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d847b534c046a7904af4cf0fcdd506'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.106623 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d847b534c046a7904af4cf0fcdd506'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.118596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d847b534c046a7904af4cf0fcdd506'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.128571 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:48.137515 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d847b534c046a7904af4cf0fcdd506'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.139493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3e883370-14fa-4fe5-a311-92fedccb2a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d847b534c046a7904af4cf0fcdd506'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.163322 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1432/2837] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:36:47 2022] DELETE /identity/v3/users/83d847b534c046a7904af4cf0fcdd506 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:36:48.390020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:48.391027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:48.415981 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f935f-24a4-464a-af77-5e8333f59e64 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:48.513843 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:48.515121 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:48.515493 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:48.515930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] PATH_INFO: `/v3/projects/5eaab07332934e04be0aab4a51cdde12` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:48.517228 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaab07332934e04be0aab4a51cdde12)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:48.520051 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:48.577719 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaab07332934e04be0aab4a51cdde12', 'request_id': 'req-32ad035c-acb6-4ac6-8a78-664c72a7b844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.588010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaab07332934e04be0aab4a51cdde12', 'request_id': 'req-32ad035c-acb6-4ac6-8a78-664c72a7b844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.595801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaab07332934e04be0aab4a51cdde12', 'request_id': 'req-32ad035c-acb6-4ac6-8a78-664c72a7b844'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.601720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:48.616296 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] The token cache is being invalidate because project 5eaab07332934e04be0aab4a51cdde12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:36:48.616990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.619602 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:36:48.621859 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1406/2838] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:36:48 2022] DELETE /identity/v3/projects/5eaab07332934e04be0aab4a51cdde12 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:36:51.340017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740831f8-6944-4f54-a168-860d0277502b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:51.340901 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740831f8-6944-4f54-a168-860d0277502b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:51.341329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740831f8-6944-4f54-a168-860d0277502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:51.372304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-740831f8-6944-4f54-a168-860d0277502b None None] MFA Rules not processed for user `6641b5ca706c4621812aad8450891ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:51.373862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-740831f8-6944-4f54-a168-860d0277502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:51.461003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1433/2839] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:36:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:51.475995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:51.477580 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:51.549105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad035c-acb6-4ac6-8a78-664c72a7b844 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:51.554230 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e473709ec4428db98fb7cd9009d644', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:51.555027 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:51.555308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:51.555579 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:51.557541 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:51.628851 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:51.631379 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:51.643142 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1407/2840] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:36:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:36:51.817703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5d1a-16e0-467a-b0d2-61a8d1431083 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:51.818273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5d1a-16e0-467a-b0d2-61a8d1431083 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:51.818700 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5d1a-16e0-467a-b0d2-61a8d1431083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:51.841059 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-28ed5d1a-16e0-467a-b0d2-61a8d1431083 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:36:51.842281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28ed5d1a-16e0-467a-b0d2-61a8d1431083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:51.912736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1434/2841] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:36:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:36:51.927625 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:36:51.930825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:36:52.010415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732bf55-823e-4194-943e-2660f38f3a5e service glance] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:36:52.015923 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:36:52.016527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:36:52.016848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:36:52.017123 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:36:52.025559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:36:52.027148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:36:52.036424 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1408/2842] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:37:00.913601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7757-1252-4d0a-9a39-e4febb5176e5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:00.914085 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7757-1252-4d0a-9a39-e4febb5176e5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:00.914213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7757-1252-4d0a-9a39-e4febb5176e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:00.933227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ef9f7757-1252-4d0a-9a39-e4febb5176e5 None None] MFA Rules not processed for user `dbe848ebaca542e798f078f6dac8d284`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:37:00.934403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ef9f7757-1252-4d0a-9a39-e4febb5176e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:00.941393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1435/2843] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:37:01.197141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:37:01.198577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:01.240482 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:01.256080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f9c17-aecb-4a40-b904-8cc7655286b3 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:37:01.259784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:37:01.260385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:01.260696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:01.260967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:01.262676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:01.272751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:37:01.274179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:37:01.281973 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1409/2844] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:37:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:37:02.855384 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:02.855915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:02.856092 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:02.876452 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:37:02.877703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:02.885121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1436/2845] 10.222.0.71 () {58 vars in 1009 bytes} [Mon Sep 19 11:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:37:02.897784 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:37:02.911170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738a1cb-f38b-447a-b871-781c92db8531 service neutron] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:37:02.916190 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:37:02.916819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:02.917100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:02.917501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:02.926041 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:37:02.927618 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:37:02.935985 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1410/2846] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:37:12.870554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=71,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:12.932660 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=15 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:15.699677 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:37:15.701528 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:15.789277 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba80d3d-fe98-496a-be36-386ea65d4562 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:37:15.794932 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:37:15.795547 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:15.795824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:15.796093 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:15.797865 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:15.824949 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:37:15.826656 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:37:15.839859 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1437/2847] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:37:21.279646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:37:21.302261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc163-1f17-485a-9dd6-a81e51c57451 service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:37:21.302261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:37:21.302261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:21.302261 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:21.304777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:21.304777 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:21.315588 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:37:21.317294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:37:21.328957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1411/2848] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:37:25.835768 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=34 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:29.196083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:37:29.197534 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:37:29.209017 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1599cd-fa74-4231-80bf-5ca52c7621c5 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:37:29.212710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:37:29.213311 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:37:29.213591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:37:29.213862 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:37:29.223498 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:37:29.224968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:37:29.234400 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1438/2849] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:37:31.326819 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:39.230198 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:04.547990 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:04.549525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:04.563376 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92ddec-aa41-45e2-967c-d379d97fc719 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:04.569445 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:04.570032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:04.570394 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:04.570765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:04.572459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:04.629313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:04.630932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:04.640031 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1412/2850] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:38:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:38:14.635906 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=28 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:24.679958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:24.688769 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee4e5-0807-4ee4-89e7-2400e61c7c9f service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:24.693130 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:24.693719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:24.693999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:24.694272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:24.696009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:24.759774 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:24.761246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:24.771314 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1439/2851] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:38:27.787526 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:27.789184 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:27.805741 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f4481-647b-46b4-81e6-6dd6deff62fb service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:27.810365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:27.810988 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:27.811263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:27.811531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] PATH_INFO: `/v3/users/5a306892d62443c598135dd717a3f04b` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:27.812670 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a306892d62443c598135dd717a3f04b)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:27.814556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:27.861069 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a306892d62443c598135dd717a3f04b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:27.867911 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a306892d62443c598135dd717a3f04b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:27.880322 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a306892d62443c598135dd717a3f04b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:27.881046 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a306892d62443c598135dd717a3f04b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:27.881649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1dcffd03-a4b6-4048-bca9-791ea1e00319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a306892d62443c598135dd717a3f04b'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:27.895814 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1413/2852] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:38:27 2022] DELETE /identity/v3/users/5a306892d62443c598135dd717a3f04b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:38:28.070975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.083679 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b31ce8-0355-4fb6-bbe4-ed7d3824cd33 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.141899 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.142432 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.142712 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.142980 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] PATH_INFO: `/v3/projects/3930cdb61e7046bc9e0de11be124a3a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.145214 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3930cdb61e7046bc9e0de11be124a3a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.147104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.193611 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3930cdb61e7046bc9e0de11be124a3a5', 'request_id': 'req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:28.199804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3930cdb61e7046bc9e0de11be124a3a5', 'request_id': 'req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:28.205567 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3930cdb61e7046bc9e0de11be124a3a5', 'request_id': 'req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:28.218900 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] The token cache is being invalidate because project 3930cdb61e7046bc9e0de11be124a3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:38:28.219188 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:28.219799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25d02702-8b9f-4c5d-a79b-24f2e25ec3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:38:28.221308 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1440/2853] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:38:28 2022] DELETE /identity/v3/projects/3930cdb61e7046bc9e0de11be124a3a5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:38:28.227088 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.227373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.227644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.247434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:38:28.248655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:28.311068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1414/2854] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:38:28.320670 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c449-f78a-407b-b785-901e048c68dd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.320959 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c449-f78a-407b-b785-901e048c68dd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.321236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c449-f78a-407b-b785-901e048c68dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.342336 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c654c449-f78a-407b-b785-901e048c68dd None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:38:28.343556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c654c449-f78a-407b-b785-901e048c68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:28.353015 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1441/2855] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:38:28.357393 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.367815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc0792-669b-4b0d-ab88-8ac5e791e866 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.372717 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.373319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.373598 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.373865 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] PATH_INFO: `/v3/domains` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.374540 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81386) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:38:28.374838 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.376433 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.396461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1415/2856] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:38:28.400907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654c449-f78a-407b-b785-901e048c68dd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.411426 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654c449-f78a-407b-b785-901e048c68dd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.416054 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.416684 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.416958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.417224 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.417837 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.419699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.436281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:28.450010 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1442/2857] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:38:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:38:28.454141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.464703 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f98b1-9797-48f8-befc-a3a5db22254b admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.520572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.521188 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.521470 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.521740 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] PATH_INFO: `/v3/users` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.522370 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.524285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.532265 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:28.547425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1416/2858] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:38:28 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:38:28.551552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.561674 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa8e61-9074-410d-96b6-9ce01a55708e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.567189 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.567783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.568088 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.568376 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.569072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.570673 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.580449 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1443/2859] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:38:28.585358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.595271 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe451-2a39-43d5-b484-afb88d9ea368 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.600256 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.600872 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.601151 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.601418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.602078 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.603649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a06c0-a706-4f7d-ae67-3e86dfc6afd5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.614555 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1417/2860] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:38:28.619031 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.630360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80fa4b-13cf-497b-8ddd-a1b328fa0efc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.635001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.635637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.635907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.636171 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] PATH_INFO: `/v3/projects/bf2f46abb08d420495eeb4ad410dedde/users/7b4c5c53559d4c3dbdf9f1a25cb9bf31/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.651983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2f46abb08d420495eeb4ad410dedde, user_id=7b4c5c53559d4c3dbdf9f1a25cb9bf31, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.656295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.671907 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1444/2861] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:38:28 2022] PUT /identity/v3/projects/bf2f46abb08d420495eeb4ad410dedde/users/7b4c5c53559d4c3dbdf9f1a25cb9bf31/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:38:28.677704 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e38f-861c-4199-9cc1-c09349c333e0 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.677991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e38f-861c-4199-9cc1-c09349c333e0 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.678267 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e38f-861c-4199-9cc1-c09349c333e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.698006 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-08d4e38f-861c-4199-9cc1-c09349c333e0 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:38:28.704076 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-08d4e38f-861c-4199-9cc1-c09349c333e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:28.765075 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1418/2862] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:38:28.775158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:28.776894 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:28.834248 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4dbf-c9cc-4747-8d8a-c06ac270cd5c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:28.838026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:28.838627 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:28.838906 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:28.839177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:28.848454 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:28.849914 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:28.859216 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1445/2863] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:38:33.024287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d0c-6fcc-449e-8d36-8ac6f4fe4655 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:33.024815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d0c-6fcc-449e-8d36-8ac6f4fe4655 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:33.024912 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c4d0c-6fcc-449e-8d36-8ac6f4fe4655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:33.053951 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-f56c4d0c-6fcc-449e-8d36-8ac6f4fe4655 None None] MFA Rules not processed for user `7b4c5c53559d4c3dbdf9f1a25cb9bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:38:33.055179 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-f56c4d0c-6fcc-449e-8d36-8ac6f4fe4655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:33.129141 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1419/2864] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:38:33.144463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:33.145983 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:33.226719 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd652-7e47-4470-b8c2-3e4464bffc32 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:33.232260 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:33.232904 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:33.233181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:33.233448 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:33.242885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:33.244468 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:33.255536 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1446/2865] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:38:34.549105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8eb22-c9c2-4e98-9c1b-b0d0b5982372 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:34.550241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8eb22-c9c2-4e98-9c1b-b0d0b5982372 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:34.550695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8eb22-c9c2-4e98-9c1b-b0d0b5982372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:34.572143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0af8eb22-c9c2-4e98-9c1b-b0d0b5982372 None None] MFA Rules not processed for user `7b4c5c53559d4c3dbdf9f1a25cb9bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:38:34.573888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0af8eb22-c9c2-4e98-9c1b-b0d0b5982372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:34.588273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1420/2866] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:38:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:38:43.250479 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:44.566806 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:48.524020 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:38:48.525527 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:48.594721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116577a4-d1af-47cb-9832-ced167ca0138 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:38:48.600236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:38:48.601484 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:38:48.601763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:38:48.602023 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:38:48.604318 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:38:48.615943 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:38:48.617568 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada41d3-626b-41e7-9ea1-36e1a63af332 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:38:48.628116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1447/2867] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:38:58.623563 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=32 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:08.688559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:08.689178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:08.689178 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:08.714015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] MFA Rules not processed for user `7b4c5c53559d4c3dbdf9f1a25cb9bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:40:08.715680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:08.726295 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1421/2868] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:40:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:40:13.962433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:13.962967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:13.962967 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:13.982728 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] MFA Rules not processed for user `93e0aaed859841b6b45b2a98a59ef5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:40:13.983936 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:14.041237 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1448/2869] 10.222.0.71 () {58 vars in 967 bytes} [Mon Sep 19 11:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:40:14.086867 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:40:14.088268 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:14.160196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe29d17-249d-43dc-bb20-b4b539004296 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:40:14.165835 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e8f4cb893a4a119ffa520b2b7f6efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:40:14.166460 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:14.167372 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:14.167655 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:14.190161 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:40:14.191947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:40:14.202000 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1422/2870] 10.222.0.71 () {60 vars in 1384 bytes} [Mon Sep 19 11:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:40:21.192495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:40:21.194403 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:21.215756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a4976-fb5b-43dc-ad94-9a2bd9fc59d3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:40:21.220251 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:40:21.220941 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:21.221218 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:21.221519 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] PATH_INFO: `/v3/users/dbe848ebaca542e798f078f6dac8d284` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:21.223186 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe848ebaca542e798f078f6dac8d284)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:40:21.225156 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:40:21.272329 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe848ebaca542e798f078f6dac8d284'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.273019 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe848ebaca542e798f078f6dac8d284'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.279778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe848ebaca542e798f078f6dac8d284'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.292269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe848ebaca542e798f078f6dac8d284'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.292975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe848ebaca542e798f078f6dac8d284'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.306162 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1449/2871] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:40:21 2022] DELETE /identity/v3/users/dbe848ebaca542e798f078f6dac8d284 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:40:21.472337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:40:21.484032 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713a157-6bf7-4319-bbeb-86671d917acc service swift] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:40:21.541175 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:40:21.541801 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:21.542085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:21.542355 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] PATH_INFO: `/v3/projects/4fb0d2e9c3544096a745fc1ea013db12` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:21.543457 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb0d2e9c3544096a745fc1ea013db12)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:40:21.545399 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:40:21.593206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb0d2e9c3544096a745fc1ea013db12', 'request_id': 'req-09f7b80e-4750-4c20-be40-4858b5743017'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.603105 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb0d2e9c3544096a745fc1ea013db12', 'request_id': 'req-09f7b80e-4750-4c20-be40-4858b5743017'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.610780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb0d2e9c3544096a745fc1ea013db12', 'request_id': 'req-09f7b80e-4750-4c20-be40-4858b5743017'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.623328 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] The token cache is being invalidate because project 4fb0d2e9c3544096a745fc1ea013db12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:40:21.623696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.624362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.625907 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1423/2872] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:40:21 2022] DELETE /identity/v3/projects/4fb0d2e9c3544096a745fc1ea013db12 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:40:21.630066 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:40:21.631491 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:21.645296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a97c-cde8-4e9b-8ead-320a5aed27ba admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:40:21.703280 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:40:21.704121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:21.704495 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:21.704844 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] PATH_INFO: `/v3/users/6641b5ca706c4621812aad8450891ae7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:21.706116 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6641b5ca706c4621812aad8450891ae7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:40:21.710558 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:40:21.733972 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:21.762461 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6641b5ca706c4621812aad8450891ae7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.763177 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6641b5ca706c4621812aad8450891ae7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.771197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6641b5ca706c4621812aad8450891ae7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.784437 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6641b5ca706c4621812aad8450891ae7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.785756 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6641b5ca706c4621812aad8450891ae7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:21.798501 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1450/2873] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:40:21 2022] DELETE /identity/v3/users/6641b5ca706c4621812aad8450891ae7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:40:21.982362 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:40:21.983949 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:40:22.000291 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b80e-4750-4c20-be40-4858b5743017 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:40:22.011262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:22.059823 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:40:22.060446 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:40:22.060755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:40:22.061025 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] PATH_INFO: `/v3/projects/92eadf25a65a46c9987a5515b29ff4d5` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:40:22.062137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92eadf25a65a46c9987a5515b29ff4d5)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:40:22.064013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:40:22.109160 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92eadf25a65a46c9987a5515b29ff4d5', 'request_id': 'req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:22.116182 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92eadf25a65a46c9987a5515b29ff4d5', 'request_id': 'req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:22.122802 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92eadf25a65a46c9987a5515b29ff4d5', 'request_id': 'req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:22.133292 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] The token cache is being invalidate because project 92eadf25a65a46c9987a5515b29ff4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:40:22.133601 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:22.134237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:40:22.135880 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1424/2874] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:40:21 2022] DELETE /identity/v3/projects/92eadf25a65a46c9987a5515b29ff4d5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:40:31.795060 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=8,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:32.130868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:39.621810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:39.623250 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:39.679951 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0472f-4320-49af-90f6-c324be38401d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:39.729040 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:39.729637 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:39.729912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:39.730180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:39.731920 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:39.803178 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:39.804630 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:39.816597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1451/2875] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:41:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:41:41.213616 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:41.215096 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:41.271196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb19d1-d501-4c28-a118-7f3d58ec8e23 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:41.274961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:41.275733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:41.275945 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:41.276136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:41.277900 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:41.291862 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:41.293467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ea50c-70f1-4da5-b9e3-2f0f92b0ff28 service neutron] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:41.304294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1425/2876] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:41:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:41:44.256846 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:44.266540 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d82dc-1092-498d-9e56-39d04d6e3cbe service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:44.270155 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:44.270723 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:44.271181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:44.271286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:44.273098 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:44.283160 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:44.284556 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:44.293392 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1452/2877] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:41:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:41:51.299459 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=26 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:52.317097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.317698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.317698 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.336718 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] MFA Rules not processed for user `7b4c5c53559d4c3dbdf9f1a25cb9bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:41:52.338623 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:52.393898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1426/2878] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:41:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:41:52.699458 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:52.707996 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58e2a-969c-4332-86c2-cda9b959729c service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:52.712121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:52.713304 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:52.713801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:52.714104 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:52.715792 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:52.725169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:52.726552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:52.734204 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1453/2879] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:41:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:41:53.060373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:41:53.061933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:53.131507 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9406e9-e7c9-4c9d-8d12-fd39ef7b1c4e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:41:53.137167 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:41:53.137769 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:41:53.138050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:41:53.138324 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:41:53.140050 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:41:53.151649 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:41:53.153307 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d455f3-1362-402b-bd39-6a40099f4cbd service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:41:53.163212 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1427/2880] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:41:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:42:02.730830 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:03.158960 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=57 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:18.003058 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:18.006692 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:18.030401 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efdc13-b23e-46b9-acfc-b4b6865d4493 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:18.037816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:18.038428 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:18.038701 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:18.039166 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:18.041184 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:18.055421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:18.057557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:18.070939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1454/2881] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:43:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:43:20.674780 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:20.675316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:20.675316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:20.693767 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] MFA Rules not processed for user `7b4c5c53559d4c3dbdf9f1a25cb9bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:43:20.694961 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:20.701866 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1428/2882] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:43:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:43:21.002839 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:21.012033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e77-c366-43c0-abdc-e698d2e5a5f0 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:21.016112 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:21.016724 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:21.017003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:21.017269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:21.018985 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:21.028493 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:21.029954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:21.038071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1455/2883] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:43:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:43:30.688425 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:30.993095 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:31.008940 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aeb7a-2cf1-439e-b6a2-29659865e226 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:31.014893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:31.015563 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:31.015809 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:31.016068 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:31.017840 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:31.030131 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:31.031762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:31.034359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=12 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:31.043042 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1429/2884] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:43:32.880169 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:32.894987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb216f4-0822-486f-9885-b7d1356826dd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:32.900832 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00af7c59942242d5ba2517f2c1b07d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:32.901444 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:32.901718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:32.901995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:32.903799 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:32.916988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:32.918730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:32.932135 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1456/2885] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:43:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:43:41.039100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=6 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:42.926373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:52.505824 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:43:52.563102 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdbb51-dcf3-4455-9f2c-ef6dd6564424 service nova] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:43:52.568064 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:43:52.568687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:43:52.568963 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:43:52.569231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:43:52.570966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:43:52.603559 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:43:52.605196 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:43:52.615508 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1430/2886] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:43:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:44:02.611352 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=36 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:52.502962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:52.504347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:52.556552 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a7f2-d923-4f9d-9b01-e316f57120e9 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:52.560220 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:52.560845 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:52.561118 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:52.561382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:52.563071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:52.623281 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:52.624703 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:52.633898 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1457/2887] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:44:55.727274 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:55.737926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4edcd-9050-4753-9a57-324cc446072c service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:55.743738 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:55.744336 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:55.744899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:55.745164 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:55.746926 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:55.760090 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:55.761707 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:55.772471 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1431/2888] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:44:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:44:55.793044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:55.794736 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:55.808275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec0da-5a35-4452-b9bc-ee72b4020abf service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:55.813708 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:55.816026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:55.816326 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:55.816632 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] PATH_INFO: `/v3/users/7b4c5c53559d4c3dbdf9f1a25cb9bf31` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:55.818361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4c5c53559d4c3dbdf9f1a25cb9bf31)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:55.820249 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:55.869591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4c5c53559d4c3dbdf9f1a25cb9bf31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:55.870510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4c5c53559d4c3dbdf9f1a25cb9bf31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:55.885217 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4c5c53559d4c3dbdf9f1a25cb9bf31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:55.897298 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4c5c53559d4c3dbdf9f1a25cb9bf31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:55.898024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2c521440-c59a-4554-b9b4-dd3c6b44dd48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4c5c53559d4c3dbdf9f1a25cb9bf31'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:55.910005 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1458/2889] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:44:55 2022] DELETE /identity/v3/users/7b4c5c53559d4c3dbdf9f1a25cb9bf31 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:56.080008 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.091442 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7579-f102-49e7-b9d8-3f5f3d60bf99 service placement] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.148901 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.149533 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.149813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.150085 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] PATH_INFO: `/v3/projects/bf2f46abb08d420495eeb4ad410dedde` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.151427 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2f46abb08d420495eeb4ad410dedde)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.153358 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.200517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2f46abb08d420495eeb4ad410dedde', 'request_id': 'req-e42bcdda-ad60-4683-90ce-19a70be5980d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:56.210080 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2f46abb08d420495eeb4ad410dedde', 'request_id': 'req-e42bcdda-ad60-4683-90ce-19a70be5980d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:56.216699 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2f46abb08d420495eeb4ad410dedde', 'request_id': 'req-e42bcdda-ad60-4683-90ce-19a70be5980d'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:56.228416 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] The token cache is being invalidate because project bf2f46abb08d420495eeb4ad410dedde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:44:56.228680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:56.229334 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-e42bcdda-ad60-4683-90ce-19a70be5980d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:44:56.230830 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1432/2890] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:44:56 2022] DELETE /identity/v3/projects/bf2f46abb08d420495eeb4ad410dedde => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:56.235596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.235884 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.236273 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.256942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:56.258119 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:56.278050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:56.321081 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1459/2891] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:44:56.329316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.329534 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.329832 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.349713 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:56.350908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:56.358765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1433/2892] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:44:56.362875 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.373357 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2671c3-9369-4053-9232-0c60144487c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.377881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.378460 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.378733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.378999 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.379631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:44:56.380505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.382099 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.393283 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1460/2893] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:44:56.398848 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.408071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a55be8-d433-4811-a395-644bf7a39d6f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.412854 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.413438 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.413710 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.413976 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.414626 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.416495 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.443263 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1434/2894] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:56.447499 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.457074 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa79-0eb9-4fa6-bf4b-37c359161e20 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.519071 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.519678 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.519958 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.520230 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.521729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.523634 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.546805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1461/2895] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:44:56.550924 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.561693 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcde3-f6fa-4408-b854-ae9f74379103 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.566646 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.567746 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.568789 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.569094 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.569727 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.571323 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.581636 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1435/2896] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:44:56.587018 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.597296 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1402b-4b3a-4f67-a251-6ce7e11ae4ba admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.602613 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.603211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.603488 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.603760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.604492 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.606631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f15cc-b227-48dd-b0c7-c38bfa708d33 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.619374 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1462/2897] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:44:56.623839 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.634922 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ab68-87cf-4d01-8cd3-c75394d86b7f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.639644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.640282 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.640562 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.640874 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] PATH_INFO: `/v3/projects/d8aa6a1eab634ec5805444ec686b9d51/users/28d23fe4999a43e8af31321c0601c317/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.655663 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8aa6a1eab634ec5805444ec686b9d51, user_id=28d23fe4999a43e8af31321c0601c317, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.658341 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.671697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1436/2898] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:44:56 2022] PUT /identity/v3/projects/d8aa6a1eab634ec5805444ec686b9d51/users/28d23fe4999a43e8af31321c0601c317/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:56.735549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.735831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.736108 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.765721 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] MFA Rules not processed for user `28d23fe4999a43e8af31321c0601c317`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:56.766931 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:56.830235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1463/2899] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:44:56.835532 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.849321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:56.908316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ce6f-ce31-4749-b9e7-e3ec77cba5a3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.913538 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:56.914140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:56.914415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:56.914680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:56.915308 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:56.917302 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:56.949297 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1437/2900] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:56.953402 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:56.964617 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0e70-119d-4310-a4ab-8f573087fe34 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:56.983274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:57.024124 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.024749 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.025026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.025312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.025928 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.027817 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.049295 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1464/2901] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:44:56 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:44:57.054133 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.064207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29c0a6-735b-497d-b34a-2428530e73bf admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.068889 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.069479 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.069753 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.070020 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.070650 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.072225 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.083573 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1438/2902] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:44:57.087596 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.097371 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886bc1-2db4-4042-bf20-4b81ace75a7a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.102599 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.103235 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.103512 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.103784 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] PATH_INFO: `/v3/projects/5586dadcf45345c1b1d727238be42815/users/1346a688febc4b6ab798a565a5664c83/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.119033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5586dadcf45345c1b1d727238be42815, user_id=1346a688febc4b6ab798a565a5664c83, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.121957 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.134361 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1465/2903] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:44:57 2022] PUT /identity/v3/projects/5586dadcf45345c1b1d727238be42815/users/1346a688febc4b6ab798a565a5664c83/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:57.138285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.148140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cfa04-6cc4-427d-b414-b55f909b6e88 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.208952 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.209680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.209966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.210241 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.210885 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.212484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d9685-4651-4db2-b586-787e0f0d9720 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.222450 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1439/2904] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:44:57.227180 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.237356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208655-f462-4227-a10c-7553ebf4db8d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.242759 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.243804 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.244091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.244363 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] PATH_INFO: `/v3/projects/5586dadcf45345c1b1d727238be42815/users/1346a688febc4b6ab798a565a5664c83/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.246581 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5586dadcf45345c1b1d727238be42815, user_id=1346a688febc4b6ab798a565a5664c83, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.249303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.261211 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1466/2905] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:44:57 2022] PUT /identity/v3/projects/5586dadcf45345c1b1d727238be42815/users/1346a688febc4b6ab798a565a5664c83/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:44:57.271628 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.271904 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.272170 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.303449 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] MFA Rules not processed for user `1346a688febc4b6ab798a565a5664c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:44:57.304732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:57.373128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1440/2906] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:44:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:44:57.384733 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.386445 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:44:57.443960 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc252e-e122-4cb8-b8d0-24bc3700aca0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.447968 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.448549 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.448852 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.449115 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.458316 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.459786 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.468942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1467/2907] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:44:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:44:57.550871 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:44:57.560998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57f0a-583f-4756-9567-3552c22726ad None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:44:57.564668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:44:57.565294 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:44:57.565571 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:44:57.565837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:44:57.571537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:57.626549 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:44:57.627931 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011d811-0472-4bb6-828c-418d13095174 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:44:57.637357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1441/2908] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:44:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:02.338803 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:02.419514 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c26e-4ccb-42dc-b395-9a886dc772b0 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:02.424313 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:02.424962 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:02.425236 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:02.425503 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] PATH_INFO: `/v3/users/28d23fe4999a43e8af31321c0601c317` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:02.426631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d23fe4999a43e8af31321c0601c317)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:02.429651 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:02.431139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:02.478475 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d23fe4999a43e8af31321c0601c317'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:02.479027 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d23fe4999a43e8af31321c0601c317'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:02.485976 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d23fe4999a43e8af31321c0601c317'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:02.498854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d23fe4999a43e8af31321c0601c317'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:02.499510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d23fe4999a43e8af31321c0601c317'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:02.511854 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1468/2909] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:02 2022] DELETE /identity/v3/users/28d23fe4999a43e8af31321c0601c317 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:02.516339 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:02.516856 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:02.516956 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:02.547461 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:02.548702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:02.606687 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1442/2910] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:02.616485 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:02.617954 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:02.674388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f379-9da6-4121-a1cd-f2d346be4f01 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:02.677991 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:02.678730 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:02.679009 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:02.679274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:02.688223 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:02.689664 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:02.701330 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1469/2911] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:02.966737 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:02.969015 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:02.987745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbbf7-561d-42b4-aff1-cd63dbc5cf26 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:02.995594 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:02.996638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:02.997132 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:02.997609 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] PATH_INFO: `/v3/projects/d8aa6a1eab634ec5805444ec686b9d51` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:02.999483 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8aa6a1eab634ec5805444ec686b9d51)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.003329 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.052128 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8aa6a1eab634ec5805444ec686b9d51', 'request_id': 'req-9474690a-2dd0-470d-a278-8a19b747af70'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.059285 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8aa6a1eab634ec5805444ec686b9d51', 'request_id': 'req-9474690a-2dd0-470d-a278-8a19b747af70'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.065771 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8aa6a1eab634ec5805444ec686b9d51', 'request_id': 'req-9474690a-2dd0-470d-a278-8a19b747af70'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.076732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] The token cache is being invalidate because project d8aa6a1eab634ec5805444ec686b9d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:03.077023 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.077656 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.079136 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1443/2912] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:02 2022] DELETE /identity/v3/projects/d8aa6a1eab634ec5805444ec686b9d51 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:03.083245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.093511 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103998-302a-428b-8754-1a3d155c17d2 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.149718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.150333 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.150609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.150885 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] PATH_INFO: `/v3/users/1346a688febc4b6ab798a565a5664c83` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.151995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1346a688febc4b6ab798a565a5664c83)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.153918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.175487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:03.201033 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1346a688febc4b6ab798a565a5664c83'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.201816 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1346a688febc4b6ab798a565a5664c83'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.213570 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1346a688febc4b6ab798a565a5664c83'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.226173 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1346a688febc4b6ab798a565a5664c83'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.226867 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d8713a3a-b409-4da3-aa50-83249579b691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1346a688febc4b6ab798a565a5664c83'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.239068 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1470/2913] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:03 2022] DELETE /identity/v3/users/1346a688febc4b6ab798a565a5664c83 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:03.502117 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.503545 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:03.517229 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474690a-2dd0-470d-a278-8a19b747af70 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.534776 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:03.577382 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.578024 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.578301 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.578569 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] PATH_INFO: `/v3/projects/5586dadcf45345c1b1d727238be42815` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.579696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5586dadcf45345c1b1d727238be42815)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.581723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.627967 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5586dadcf45345c1b1d727238be42815', 'request_id': 'req-04a11778-3975-478d-b71a-834edcc36312'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.636029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5586dadcf45345c1b1d727238be42815', 'request_id': 'req-04a11778-3975-478d-b71a-834edcc36312'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.642321 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5586dadcf45345c1b1d727238be42815', 'request_id': 'req-04a11778-3975-478d-b71a-834edcc36312'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.652772 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] The token cache is being invalidate because project 5586dadcf45345c1b1d727238be42815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:03.653058 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.653682 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-04a11778-3975-478d-b71a-834edcc36312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:03.655153 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1444/2914] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:03 2022] DELETE /identity/v3/projects/5586dadcf45345c1b1d727238be42815 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:03.659975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.660455 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.660572 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.680669 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:03.681842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:03.738079 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1471/2915] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:03.747888 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.748240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.748572 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.768300 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:03.769525 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:03.777676 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1445/2916] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:03.781763 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.792050 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f4ad4-436e-4287-b69d-fb75206b117b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.796554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.797158 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.797433 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.797699 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.798332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:03.798624 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.800183 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.812421 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1472/2917] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:03.816552 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.826103 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002605de-3f2b-4f4a-887b-0fc63e2b57f5 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.830770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.831359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.831638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.831957 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.832531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.834668 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.862097 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1446/2918] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:45:03.867286 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.877393 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57c3b7-611f-4a01-a17d-e45af7dac71f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.932707 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.933303 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.933580 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.933877 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.934487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.936352 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.956847 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1473/2919] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:45:03 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:45:03.961168 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:03.971467 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29dbe9-252d-40fe-9d12-06604d6323e5 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:03.977837 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:03.979104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:03.979104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:03.979359 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:03.979810 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:03.981419 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:03.992148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1447/2920] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:03.996489 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.006494 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de612a-e142-4a5a-b6b1-e0d26e48d712 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.011149 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.011729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.012003 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.012272 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.012938 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.014504 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705fa40-7ffe-47b3-9d25-d98ad500a6b1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.025288 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1474/2921] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:04.029398 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.039665 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cd77d-b0c2-4750-a73a-66f8f04429f9 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.044199 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.044860 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.045139 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.045406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] PATH_INFO: `/v3/projects/fd7652f9331547dfb24f72ccdb47256c/users/db31abba0a024951ae4a984ef86d13b6/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.061207 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7652f9331547dfb24f72ccdb47256c, user_id=db31abba0a024951ae4a984ef86d13b6, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.063825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.076477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1448/2922] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:45:04 2022] PUT /identity/v3/projects/fd7652f9331547dfb24f72ccdb47256c/users/db31abba0a024951ae4a984ef86d13b6/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:04.087232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.087459 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.087709 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.101356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:04.117209 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] MFA Rules not processed for user `db31abba0a024951ae4a984ef86d13b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:04.118436 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:04.181805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1475/2923] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:04.186287 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.233518 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:04.248971 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143869-09ab-4cf7-ba0c-f5ffd71da9a3 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.253632 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.254210 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.254484 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.254748 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.255365 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.257357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.286530 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1449/2924] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:45:04.288246 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.298778 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3a277-068a-467a-8ed7-214b0ca4fde5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.353849 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.354365 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.354640 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.354903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.355522 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.357425 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.380312 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1476/2925] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:45:04 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:45:04.384725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.394763 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1b5e6-db65-43ed-864b-7df308da7396 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.400421 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.401104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.401316 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.401612 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.402239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.403815 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.414726 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1450/2926] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:04.418918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.428836 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f02d7f-1c1d-4315-9fa5-f14393514b2a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.433359 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.434002 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.434262 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.434532 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] PATH_INFO: `/v3/projects/469fc4f519624057853af9dd09b78c0e/users/fd48817893254869b58f292759ee6bdb/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.449609 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469fc4f519624057853af9dd09b78c0e, user_id=fd48817893254869b58f292759ee6bdb, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.452215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.465750 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1477/2927] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:45:04 2022] PUT /identity/v3/projects/469fc4f519624057853af9dd09b78c0e/users/fd48817893254869b58f292759ee6bdb/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:45:04.469731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.480411 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304018e-3efd-4f15-a2ba-45a06e1af238 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.537010 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.537690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.538011 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.538428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.539077 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.540841 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821b72-bf23-4fa5-930a-cc2b0ea1787e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.550638 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1451/2928] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:04.555070 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.565631 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176b02-19cf-49dd-9a2c-05aa4cfc53a9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.570890 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.571530 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.571810 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.572080 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] PATH_INFO: `/v3/projects/469fc4f519624057853af9dd09b78c0e/users/fd48817893254869b58f292759ee6bdb/roles/831a0d01705f489683bef40d08847bc6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.574032 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=469fc4f519624057853af9dd09b78c0e, user_id=fd48817893254869b58f292759ee6bdb, role_id=831a0d01705f489683bef40d08847bc6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.576667 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.587355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1478/2929] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:45:04 2022] PUT /identity/v3/projects/469fc4f519624057853af9dd09b78c0e/users/fd48817893254869b58f292759ee6bdb/roles/831a0d01705f489683bef40d08847bc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:04.597640 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.597929 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.598202 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.626337 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] MFA Rules not processed for user `fd48817893254869b58f292759ee6bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:04.627502 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:04.695406 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1452/2930] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:04.706091 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:04.707873 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:04.764805 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:04.769120 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264e0e2-3141-407e-8759-01ce3c95bd9f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:04.778470 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:04.779072 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:04.779344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:04.779610 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:04.840643 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:04.842051 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:04.850772 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1479/2931] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:09.079756 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:09.081208 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:09.114431 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555eb30-3b19-4f1a-940c-29187d89038e None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:09.118846 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:09.119434 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:09.119970 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:09.120237 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:09.128999 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:09.130415 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2a3d-3cf1-4994-8c84-0e51d3dd8eb5 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:09.139702 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1453/2932] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:14.028174 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:14.089075 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891633-561b-469d-bd4a-342172e0c00c service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:14.093505 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:14.094114 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:14.094390 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:14.094659 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] PATH_INFO: `/v3/users/db31abba0a024951ae4a984ef86d13b6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:14.095780 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=db31abba0a024951ae4a984ef86d13b6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:14.097710 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:14.152554 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db31abba0a024951ae4a984ef86d13b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.153213 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db31abba0a024951ae4a984ef86d13b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.159947 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db31abba0a024951ae4a984ef86d13b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.172510 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db31abba0a024951ae4a984ef86d13b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.173176 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db31abba0a024951ae4a984ef86d13b6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.185743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1480/2933] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:14 2022] DELETE /identity/v3/users/db31abba0a024951ae4a984ef86d13b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:14.190262 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:14.190762 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:14.190903 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:14.212279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:14.222565 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:14.223804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:14.282272 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1454/2934] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:14.292354 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:14.293824 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:14.320560 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:14.353497 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d553a06-91ab-4934-aa38-00ab162993ab admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:14.357094 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:14.357691 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:14.357971 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:14.358244 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:14.367353 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:14.368790 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:14.378181 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1481/2935] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:14.645938 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:14.647639 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:14.659733 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe849e-3688-4dac-85bf-de578e471844 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:14.664509 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:14.665269 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:14.665542 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:14.665813 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] PATH_INFO: `/v3/projects/fd7652f9331547dfb24f72ccdb47256c` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:14.666966 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7652f9331547dfb24f72ccdb47256c)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:14.668908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:14.716965 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7652f9331547dfb24f72ccdb47256c', 'request_id': 'req-17f88a2c-db68-48b6-9750-7cc23826bf9f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.723947 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7652f9331547dfb24f72ccdb47256c', 'request_id': 'req-17f88a2c-db68-48b6-9750-7cc23826bf9f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.730400 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7652f9331547dfb24f72ccdb47256c', 'request_id': 'req-17f88a2c-db68-48b6-9750-7cc23826bf9f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.741309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] The token cache is being invalidate because project fd7652f9331547dfb24f72ccdb47256c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:14.741696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.742496 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.743993 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1455/2936] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:14 2022] DELETE /identity/v3/projects/fd7652f9331547dfb24f72ccdb47256c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:14.748382 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:14.759139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c5419-07a7-44a6-af51-eb5deb426af2 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:14.829356 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:14.830007 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:14.830438 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:14.830888 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] PATH_INFO: `/v3/users/fd48817893254869b58f292759ee6bdb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:14.832077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd48817893254869b58f292759ee6bdb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:14.834063 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:14.883698 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd48817893254869b58f292759ee6bdb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.884274 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd48817893254869b58f292759ee6bdb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.891045 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd48817893254869b58f292759ee6bdb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.902748 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd48817893254869b58f292759ee6bdb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.903388 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-779525eb-ff01-462d-ada0-02b3b2d9096e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd48817893254869b58f292759ee6bdb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:14.917044 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1482/2937] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:14 2022] DELETE /identity/v3/users/fd48817893254869b58f292759ee6bdb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:15.182318 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.183751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:15.200100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f88a2c-db68-48b6-9750-7cc23826bf9f admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.257745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.258373 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.258647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.258916 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] PATH_INFO: `/v3/projects/469fc4f519624057853af9dd09b78c0e` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.260013 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=469fc4f519624057853af9dd09b78c0e)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.261925 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.293527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:15.309855 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469fc4f519624057853af9dd09b78c0e', 'request_id': 'req-a73c24af-dba1-45b3-854d-73ef78d1e76a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:15.316745 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469fc4f519624057853af9dd09b78c0e', 'request_id': 'req-a73c24af-dba1-45b3-854d-73ef78d1e76a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:15.323089 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469fc4f519624057853af9dd09b78c0e', 'request_id': 'req-a73c24af-dba1-45b3-854d-73ef78d1e76a'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:15.333357 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] The token cache is being invalidate because project 469fc4f519624057853af9dd09b78c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:15.333641 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:15.334895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-a73c24af-dba1-45b3-854d-73ef78d1e76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:15.336367 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1456/2938] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:15 2022] DELETE /identity/v3/projects/469fc4f519624057853af9dd09b78c0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:15.343175 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.343687 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.343801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.392349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:15.393578 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:15.406462 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:15.455642 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1483/2939] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:45:15.464319 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.464627 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.464902 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.484972 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:15.486157 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:15.493977 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1457/2940] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:15.498300 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.507697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721fb3-690b-44c2-bb9c-ca99aa7cf782 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.512157 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.512775 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.513052 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.513317 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.513950 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:15.514245 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.515808 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.527783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1484/2941] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:15.531933 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.541827 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bb286-168c-4d81-a21e-633cbc2aa92f None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.546516 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.547106 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.547386 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.547658 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.548275 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.550205 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.578140 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1458/2942] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:45:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:45:15.582083 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.592360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca5a71-8055-476a-848b-a37025241967 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.648760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.649355 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.649666 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.649942 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.650574 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.652463 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.674199 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1485/2943] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:45:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:45:15.678501 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.688695 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caef44-a7ac-4eda-95d7-42d35cd7cc24 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.693350 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.694440 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.694723 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.694995 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.695631 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.697313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.707206 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1459/2944] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:15.711965 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.721781 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ed7-f928-4757-8235-ee0098ee61cb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.726591 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.727179 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.727467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.727739 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.728373 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.729988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31c32-19e5-46cd-8816-3cbc1418fa54 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.740729 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1486/2945] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:15.744469 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.754720 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a4815-cf1f-4f11-9f65-695e4ef4fd13 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.760239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.760909 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.761185 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.761452 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] PATH_INFO: `/v3/projects/b4f5dd6d1dee49508fa8e6910769b7f4/users/7563625b8dc14bec94a43e4be7b23c5f/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.776273 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f5dd6d1dee49508fa8e6910769b7f4, user_id=7563625b8dc14bec94a43e4be7b23c5f, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.778913 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.791137 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1460/2946] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:45:15 2022] PUT /identity/v3/projects/b4f5dd6d1dee49508fa8e6910769b7f4/users/7563625b8dc14bec94a43e4be7b23c5f/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:15.802187 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.802464 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.802758 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.830411 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] MFA Rules not processed for user `7563625b8dc14bec94a43e4be7b23c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:15.831597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:15.893349 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1487/2947] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:15.905527 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:15.907231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:15.963454 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386cd0-ddfa-4336-8b2d-62c693048c84 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:15.966998 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:15.967593 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:15.967868 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:15.968134 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:15.976320 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:15.977770 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169fc2b-0456-485c-b0e8-9e1a1e05a204 service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:15.986309 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1461/2948] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:18.534113 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:18.551191 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:18.596726 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982bce4-092b-4067-af18-4ab7301daac5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:18.601335 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:18.601987 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:18.602264 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:18.602537 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] PATH_INFO: `/v3/users/7563625b8dc14bec94a43e4be7b23c5f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:18.603831 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7563625b8dc14bec94a43e4be7b23c5f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:18.605915 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:18.651934 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7563625b8dc14bec94a43e4be7b23c5f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:18.652760 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7563625b8dc14bec94a43e4be7b23c5f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:18.659796 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7563625b8dc14bec94a43e4be7b23c5f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:18.672026 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7563625b8dc14bec94a43e4be7b23c5f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:18.672697 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7563625b8dc14bec94a43e4be7b23c5f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:18.685903 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1488/2949] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:18 2022] DELETE /identity/v3/users/7563625b8dc14bec94a43e4be7b23c5f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:18.690312 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:18.690793 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:18.690895 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:18.709360 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:18.710575 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:18.758029 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:18.770732 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1462/2950] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:18.780984 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:18.782557 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:18.840441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1f88f-5f81-4a72-8047-c4190e6ecdc0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:18.844090 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:18.844715 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:18.844994 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:18.845269 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:18.854538 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:18.855956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce5df4-46aa-45c3-9bda-2dc913d97074 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:18.865232 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1489/2951] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:45:19.134644 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.136065 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:19.148512 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a125b-91dd-45ac-a6ab-dd35afec21a7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.153402 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.154035 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.154311 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.154577 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] PATH_INFO: `/v3/projects/b4f5dd6d1dee49508fa8e6910769b7f4` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.155750 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f5dd6d1dee49508fa8e6910769b7f4)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.157706 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.203604 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f5dd6d1dee49508fa8e6910769b7f4', 'request_id': 'req-1d749cb2-ae09-4096-9285-b3c31245676f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:19.213239 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f5dd6d1dee49508fa8e6910769b7f4', 'request_id': 'req-1d749cb2-ae09-4096-9285-b3c31245676f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:19.219899 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f5dd6d1dee49508fa8e6910769b7f4', 'request_id': 'req-1d749cb2-ae09-4096-9285-b3c31245676f'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:19.230758 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] The token cache is being invalidate because project b4f5dd6d1dee49508fa8e6910769b7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:19.231044 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:19.231680 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-1d749cb2-ae09-4096-9285-b3c31245676f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:19.233240 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1463/2952] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:19 2022] DELETE /identity/v3/projects/b4f5dd6d1dee49508fa8e6910769b7f4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:19.237988 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.238271 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.238541 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.258918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:19.260111 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:19.292592 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:19.321892 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1490/2953] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:19.330478 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.330755 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.331022 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.351458 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:19.352690 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:19.360348 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1464/2954] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:19.364471 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.374823 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086578cd-5ed6-4118-8fb6-3a2f18f96b74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.379337 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.379919 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.380197 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.380467 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.381140 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:45:19.381441 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.383693 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.395001 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1491/2955] 10.222.0.71 () {58 vars in 1153 bytes} [Mon Sep 19 11:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:45:19.399172 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.408148 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c507-73f3-40c3-9f6f-14dac10b15b7 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.412734 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.413852 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.414125 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.414389 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] PATH_INFO: `/v3/projects` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.415021 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.416932 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.444116 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1465/2956] 10.222.0.71 () {60 vars in 1153 bytes} [Mon Sep 19 11:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:45:19.448285 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.458121 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe660-c593-4d9a-98a7-b71005874189 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.514385 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.514975 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.515254 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.515526 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.516152 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.518082 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.540227 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1492/2957] 10.222.0.71 () {60 vars in 1144 bytes} [Mon Sep 19 11:45:19 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:45:19.544390 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.555098 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb07466-9c3d-4c60-a3ad-638af0b6947e admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.559725 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.560313 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.560622 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.560898 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.561531 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.563111 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.572908 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1466/2958] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:19.576897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.586743 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6e6a-85ec-41d0-a96a-227b4e3b172f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.591347 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.591933 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.592215 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.592487 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.593161 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.594738 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50603b6c-54df-457b-a64e-0ee91ab46b50 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.606029 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1493/2959] 10.222.0.71 () {58 vars in 1122 bytes} [Mon Sep 19 11:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:45:19.609991 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.620765 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8b313-f1e0-4d76-bf35-7574449d5726 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.625388 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.626226 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.626418 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.626775 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] PATH_INFO: `/v3/projects/7b00eab8499b4a95b4d2b173d17fe252/users/46936fc6bf2f4689bf0beef9cce968e5/roles/fab8c6e936c1459c88d7b63932c49458` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.641071 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b00eab8499b4a95b4d2b173d17fe252, user_id=46936fc6bf2f4689bf0beef9cce968e5, role_id=fab8c6e936c1459c88d7b63932c49458)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.643696 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.656231 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1467/2960] 10.222.0.71 () {60 vars in 1483 bytes} [Mon Sep 19 11:45:19 2022] PUT /identity/v3/projects/7b00eab8499b4a95b4d2b173d17fe252/users/46936fc6bf2f4689bf0beef9cce968e5/roles/fab8c6e936c1459c88d7b63932c49458 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:45:19.667442 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.667727 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.667998 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.696597 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] MFA Rules not processed for user `46936fc6bf2f4689bf0beef9cce968e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:19.697801 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:19.760128 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1494/2961] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:19.770647 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:19.772492 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:19.829100 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b6d1-e501-42ff-bdbc-eb79cd560e49 admin admin] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:19.832686 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdc5670d29254a6095b0469caf7b616f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:19.833279 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:19.833556 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:19.833825 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:19.842600 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:19.844018 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfc5ac-cbf9-417e-ae76-cbf9c87e6d5a service cinder] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:19.853377 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1468/2962] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:28.940881 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:28.976339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:29.013077 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72caf5-8af7-4ab9-b463-e6060227e2d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:29.018024 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:29.018672 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:29.018956 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:29.019228 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] PATH_INFO: `/v3/users/46936fc6bf2f4689bf0beef9cce968e5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:29.020608 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46936fc6bf2f4689bf0beef9cce968e5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:29.022524 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:29.073480 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46936fc6bf2f4689bf0beef9cce968e5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.074147 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46936fc6bf2f4689bf0beef9cce968e5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.080918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46936fc6bf2f4689bf0beef9cce968e5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.092718 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46936fc6bf2f4689bf0beef9cce968e5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.093377 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46936fc6bf2f4689bf0beef9cce968e5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.106275 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1495/2963] 10.222.0.71 () {58 vars in 1224 bytes} [Mon Sep 19 11:45:28 2022] DELETE /identity/v3/users/46936fc6bf2f4689bf0beef9cce968e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:29.110928 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] REQUEST_METHOD: `POST` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:29.111428 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:29.111537 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:29.132731 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.auth.core [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] MFA Rules not processed for user `3ab5d70b339a4058a47f19e5d4098fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81386) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:45:29.133930 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:29.146143 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:29.196652 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1469/2964] 10.222.0.71 () {58 vars in 958 bytes} [Mon Sep 19 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:45:29.206404 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:29.207897 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:29.265812 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bee3c-eb49-4e34-90b6-ba91d37f485e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:29.269457 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443218c09bc54d46a7d97a9208d9d100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:29.270057 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:29.270332 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:29.270601 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:29.280344 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:29.281842 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:29.291139 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1496/2965] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:45:29.556807 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] Authenticating user token {{(pid=81386) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:45:29.558896 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.fernet_utils [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81386) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:45:29.574004 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a866e-f9b2-42b3-83ca-6d7be2a3e112 None None] Validating token access rules against request {{(pid=81386) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:45:29.579284 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab5d70b339a4058a47f19e5d4098fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2e4c4b06fe4e64af36c6417cd1e022', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81386) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:45:29.580104 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:45:29.580385 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:45:29.580751 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] PATH_INFO: `/v3/projects/7b00eab8499b4a95b4d2b173d17fe252` {{(pid=81386) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:45:29.581893 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b00eab8499b4a95b4d2b173d17fe252)` {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:45:29.583782 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] RBAC: Authorization granted {{(pid=81386) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:45:29.631338 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b00eab8499b4a95b4d2b173d17fe252', 'request_id': 'req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.639163 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b00eab8499b4a95b4d2b173d17fe252', 'request_id': 'req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.645517 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b00eab8499b4a95b4d2b173d17fe252', 'request_id': 'req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6'} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.656371 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] The token cache is being invalidate because project 7b00eab8499b4a95b4d2b173d17fe252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81386) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:45:29.656697 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.657351 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG keystone.notifications [None req-305a35e0-f95b-4c06-8fd4-03c11e4c97d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81386) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:45:29.658804 dv-cinder-820994-5-smb devstack@keystone.service[81386]: [pid: 81386|app: 0|req: 1470/2966] 10.222.0.71 () {58 vars in 1233 bytes} [Mon Sep 19 11:45:29 2022] DELETE /identity/v3/projects/7b00eab8499b4a95b4d2b173d17fe252 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:45:39.286995 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:39.653477 dv-cinder-820994-5-smb devstack@keystone.service[81386]: DEBUG dbcounter [-] [81386] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:58.474529 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:48:58.475918 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:58.544910 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885fe6-2185-4700-803d-0dfb4a62cd9a service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:48:58.603339 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3189482c61b44937a73c99ff6ec36cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64d0f4bb6cbe479a9933412a80f42edc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:48:58.603939 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:48:58.604221 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:48:58.604496 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:48:58.606360 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:48:58.618122 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:48:58.619702 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7213a-c449-49af-bbd7-c38d4e16fabe service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:48:58.630912 dv-cinder-820994-5-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1497/2967] 10.222.0.71 () {60 vars in 1365 bytes} [Mon Sep 19 11:48:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:49:08.625783 dv-cinder-820994-5-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=58 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}